Scot Lewis Associates Ltd

Senior LLM Engineer I'm currently working with an exciting, forward-thinking company that's looking to bring on a Senior Large Language Model (LLM) Engineer to join their fully remote international team. They're focused on cutting-edge AI technologies, especially in deploying highly realistic AI characters and models at scale. If you're passionate about training and fine-tuning open-source LLMs and working with the latest AI models, this could be a perfect opportunity for you. The Role: You'll be responsible for training open-source LLMs (like Llama and Mistral) and fine-tuning them for immersive, high-quality chat experiences. Build, curate, and manage datasets, including leveraging models like GPT-4 to improve smaller LLMs. Help deploy these models at scale using tools like Hugging Face's Text Generation Inference (TGI). Collaborate with a remote team using asynchronous communication (Slack, video meetings). Tech Stack You'll Be Using: LLMs & Frameworks: Llama 3, Mistral, Axolotl, HF Transformers, PyTorch, NumPy Infrastructure: Linux, Docker, AWS, Kubernetes, Cloud GPU Providers Inference: Hugging Face TGI What You'll Need: At least 1 year of experience training open-source LLMs. Strong understanding of fine-tuning techniques (SFT, LoRA/qLoRA, RLHF). Python 3.x skills with experience in typing and data validation (Pydantic). Familiarity with HF Transformers, PyTorch, and building/manage datasets. Bonus if you've worked on conversational AI models, NSFW content, or have experience with Axolotl. What's in It for You: A fully remote, flexible working environment. The chance to work with some of the most innovative AI minds globally. Competitive compensation package. This is an excellent opportunity if you're looking for a challenge in the AI space and want to make a real impact with your skills.