Exploring Code LLMs - Instruction fine-tuning, models and quantization[AI]
Introduction: A deep-dive into LLM’s that are specialised in code generation tasks, and see if we can use them to write code. Note: Unlike copilot, we’ll focus on locally running LLM’s. This should be appealing to any developers working in enterprises that have data privacy and sharing concerns, but still want to improve their developer productivity with locally running models. To test our understanding, we’ll perform a few simple coding tasks, and compare the various methods in achieving the desired results and also show the shortcomings....
