by | Aug 7, 2024 | Analytics, Artificial Intelligence, Data and Information, Decision Support
Decoding Job Roles and identify focus areasEarly in my career, I faced multiple rejections during my interview preparations. Each failure taught me valuable lessons which eventually landed me my dream job as Machine Learning (ML) Engineer at Meta. The key to success...
by | Aug 7, 2024 | Analytics, Artificial Intelligence, Data and Information, Decision Support
How integrating Batch Normalization in an encoder-only Transformer architecture can lead to reduced training time and inference time.Image courtesy: Jr Korpa on UnsplashIntroductionThe introduction of transformer-based architectures, pioneered by the discovery of the...
by | Aug 7, 2024 | Analytics, Artificial Intelligence, Data and Information, Decision Support
Batching your inputs together can lead to substantial savings without compromising on performancePhoto by Orgalux on UnsplashIf you use LLMs to annotate or process larger datasets, chances are that you’re not even realizing that you are wasting a lot of input tokens....
by | Aug 7, 2024 | Analytics, Artificial Intelligence, Data and Information, Decision Support
Using the giant Llama 3.1 405B and Nvidia Nemotron 4 reward model to create a synthetic dataset for instruction fine-tuning.Continue reading on Towards Data Science » Using the giant Llama 3.1 405B and Nvidia Nemotron 4 reward model to create a synthetic dataset for...
by | Aug 7, 2024 | Analytics, Artificial Intelligence, Data and Information, Decision Support
An intuitive guide to text vectorizationIn my last post, we took a closer look at foundation models and large language models (LLMs). We tried to understand what they are, how they are used and what makes them special. We explored where they work well and where they...
by | Aug 7, 2024 | Analytics, Artificial Intelligence, Data and Information, Decision Support
The Battle for Access: Overcoming (Unintended) Data JailsEven when you can see the data, it might be completely useless.Thank you ChatGPT 4o for the interpreted image of Data Jail, which I define better below…Better data beats clever algorithms, but more data beats...
