Ctrl+K
Logo image Logo image
latest

Site Navigation

  • IPEX-LLM Document

Site Navigation

  • IPEX-LLM Document
Back to Homepage ↵

Section Navigation

  • IPEX-LLM Document
  • LLM in 5 minutes
  • Installation
    • CPU
    • GPU
  • Quickstart
    • bigdl-llm Migration Guide
    • Install IPEX-LLM on Linux with Intel GPU
    • Install IPEX-LLM on Windows with Intel GPU
    • Install IPEX-LLM in Docker on Windows with Intel GPU
    • Run Local RAG using Langchain-Chatchat on Intel GPU
    • Run Text Generation WebUI on Intel GPU
    • Run Open WebUI on Linux with Intel GPU
    • Run Coding Copilot on Windows with Intel GPU
    • Run Performance Benchmarking with IPEX-LLM
    • Run llama.cpp with IPEX-LLM on Intel GPU
    • Run Ollama with IPEX-LLM on Intel GPU
    • Serving using IPEX-LLM and FastChat
  • Key Features
    • PyTorch API
    • transformers-style API
      • Hugging Face transformers Format
      • Native Format
    • LangChain API
    • GPU Supports
      • Inference on GPU
      • Finetune (QLoRA)
      • Multi Intel GPUs selection
  • Examples
    • CPU
    • GPU
  • API Reference
    • IPEX-LLM PyTorch API
    • IPEX-LLM transformers-style API
    • IPEX-LLM LangChain API
  • FAQ

transformers-style API#

You may run the LLMs using transformers-style API in ipex-llm.

  • Hugging Face transformers Format

  • Native Format

previous

PyTorch API

next

Hugging Face transformers Format
Show Source

© Copyright 2024, IPEX-LLM Authors.

Created using Sphinx 4.5.0.