Tag: edge AI

Running LLMs on Edge Devices: A Practical Guide to Model Compression

Running LLMs on Edge Devices: A Practical Guide to Model Compression

Learn how to deploy LLMs on smartphones and IoT devices using model compression. We cover quantization, pruning, and distillation with practical tips for real-world hardware.

Categories

Recent Posts

Documentation Architecture: Using ADRs and Decision Logs for AI-Generated Systems May, 19 2026
Documentation Architecture: Using ADRs and Decision Logs for AI-Generated Systems
Guardrail-Aware Fine-Tuning to Reduce Hallucination in Large Language Models Feb, 1 2026
Guardrail-Aware Fine-Tuning to Reduce Hallucination in Large Language Models
Preventing Prompt Injection: A Guide to Sanitizing Inputs for Secure GenAI Apr, 10 2026
Preventing Prompt Injection: A Guide to Sanitizing Inputs for Secure GenAI
Incident Response for Generative AI: Handling Model Failures and Abuse Feb, 26 2026
Incident Response for Generative AI: Handling Model Failures and Abuse
Safety by Design in Generative AI: Embedding Protections into Product Architecture Aug, 12 2026
Safety by Design in Generative AI: Embedding Protections into Product Architecture

Menu

© 2026. All rights reserved.