N-Gram House

Tag: repetition penalty

Controlling Length and Structure in LLM Outputs: Practical Decoding Parameters

Controlling Length and Structure in LLM Outputs: Practical Decoding Parameters

Learn how to control LLM output length and structure using decoding parameters like temperature, top-k, top-p, and repetition penalties. Practical settings for real-world use cases.

Categories

  • Machine Learning (125)
  • History (50)
  • Business AI Strategy (50)
  • Software Development (39)
  • AI Security (28)

Recent Posts

Schema-Constrained Prompts: How to Force Valid JSON and Structured LLM Outputs Apr, 20 2026
Schema-Constrained Prompts: How to Force Valid JSON and Structured LLM Outputs
Continuous Batching and KV Caching: Maximizing Throughput for LLMs May, 23 2026
Continuous Batching and KV Caching: Maximizing Throughput for LLMs
Domain-Specialized Large Language Models: Code, Math, and Medicine Mar, 19 2026
Domain-Specialized Large Language Models: Code, Math, and Medicine
Mixed-Precision Training for LLMs: FP16, BF16, and Beyond Aug, 13 2026
Mixed-Precision Training for LLMs: FP16, BF16, and Beyond
Boosting LLM Accuracy: Combining RAG with Smart Decoding Strategies Aug, 30 2026
Boosting LLM Accuracy: Combining RAG with Smart Decoding Strategies

Menu

  • About
  • Terms of Service
  • Privacy Policy
  • CCPA
  • Contact

© 2026. All rights reserved.