Methods to Entry Phi-4 Utilizing Hugging Face?

Microsoft’s Phi-4 mannequin is out there on Hugging Face, providing builders a robust software for superior textual content era and reasoning duties. On this article, we’ll stroll you thru the steps to entry and use Phi-4, from making a Hugging Face account to producing outputs with the mannequin. We’ll additionally discover key options, together with its optimized efficiency for reminiscence and compute-constrained environments, and how one can successfully use Phi-4 in varied functions.

Phi 4 and its Options

Phi-4,  is a state-of-the-art language mannequin designed for superior reasoning and high-quality textual content era. On this Phi-4, we’re having about 14 billion parameters that align effectively in reminiscence and computationally restricted eventualities to make it extremely appropriate for builders in search of to include environment friendly synthetic intelligence of their functions.

The Phi-4 mannequin follows a decoder-only transformer structure with 14 billion parameters, designed to course of textual content by way of a classy pipeline. At its core, the enter textual content is first tokenized utilizing the Tiktoken tokenizer with a vocabulary dimension of 100,352, which then feeds into the token embedding layer. The primary transformer structure consists of a number of layers of self-attention mechanisms able to dealing with a 16K token context window (expanded from 4K throughout midtraining), adopted by feed-forward networks.

The mannequin was skilled on roughly 10 trillion tokens with a various knowledge composition: 40% artificial knowledge, 15% net rewrites, 15% filtered net knowledge, 20% code knowledge, and 10% focused acquisitions. The coaching pipeline progressed by way of three important phases: pre-training (with 4K context), mid-training (expanded to 16K context), and fine-tuning. Publish-training enhancements included Supervised High-quality-tuning (SFT), Direct Desire Optimization (DPO) with pivotal token search, and judge-guided knowledge, culminating in a language mannequin that outputs chance distributions over its vocabulary to generate responses.

You’ll be able to learn extra about Phi-4 right here.

Options of Phi-4

• Context Size: Phi-4 helps a context size of as much as 16,000 tokens, permitting for intensive conversations or detailed textual content era.
• Security Measures: The mannequin incorporates strong security options, together with supervised fine-tuning and choice optimization, to make sure protected and useful interactions.

Stipulations

Earlier than getting began into the method of accessing PHI 4, be sure to have the next stipulations:

• Hugging Face Account: You will want a Hugging Face account to entry and use fashions from the Hub.
• Python Atmosphere: Guarantee you’ve Python 3.7 or later put in in your machine.
• Libraries: Set up the required libraries.

Use the next instructions to put in them:

pip set up transformers
pip set up torch

Methods to Entry Phi-4 Utilizing Hugging Face?

Under we’ll present you the best way to simply entry and make the most of Microsoft’s Phi-4 mannequin on Hugging Face, enabling highly effective textual content era and reasoning capabilities on your functions. Comply with our step-by-step directions to get began shortly and effectively.

Step 1: Making a Hugging Face Account

To entry PHI 4 and different fashions, you first have to create an account on Hugging Face. Go to Hugging Face’s web site and enroll. After creating an account, you’ll have the ability to entry personal and public fashions hosted on the platform.

Step 2: Authenticate with Hugging Face

To entry personal fashions like PHI 4, you have to authenticate your Hugging Face account. You need to use the Hugging Face CLI software to take action:

Set up the CLI software:

pip set up huggingface_hub

Log in to your Hugging Face account by working the next command:

huggingface-cli login

Enter your credentials or token when prompted.

Step 3: Set up Required Libraries

First, guarantee you’ve the transformers library put in. You’ll be able to set up it utilizing pip:

pip set up transformers

Step 4: Load the Phi-4 Mannequin

As soon as the library is put in, you possibly can load the Phi-4 mannequin utilizing the pipeline API from Hugging Face. Right here’s how you are able to do it:

import transformers

# Load the Phi-4 mannequin
pipeline = transformers.pipeline(
    "text-generation",
    mannequin="microsoft/phi-4",
    model_kwargs={"torch_dtype": "auto"},
    device_map="auto",
)

Step 5: Put together Your Enter

Phi-4 is optimized for chat-style prompts. You’ll be able to construction your enter as follows:

messages = [
    {"role": "system", "content": "You are a data scientist providing insights and explanations to a curious audience."},
    {"role": "user", "content": "How should I explain machine learning to someone new to the field?"},
]

Step 6: Producing Output

Use the pipeline to generate responses based mostly in your enter:

outputs = pipeline(messages, max_new_tokens=128)
print(outputs[0]['generated_text'])

Output:

Conclusion

Phi-4 is now totally accessible on Hugging Face, making it simpler than ever for builders and researchers to leverage its capabilities for varied functions. Whether or not you’re constructing chatbots, academic instruments, or any software requiring superior language understanding, Phi-4 stands out as a robust choice.

For additional particulars and updates, you possibly can discuss with the official Hugging Face documentation and discover the capabilities of this modern mannequin.

Regularly Requested Questions

Hello, I’m Janvi, a passionate knowledge science fanatic at the moment working at Analytics Vidhya. My journey into the world of knowledge started with a deep curiosity about how we are able to extract significant insights from complicated datasets.