PinnedExploring Large Language ModelsLanguage Understanding, Task Generalization, Causal Reasoning, Explainability/Hallucinations, Quantisation, Fine-Tuning via Instruct Training — This article is written primarily for self-study. So it goes broadly and also deep. Feel free to skip certain sections based on your interests or to seek the area that interests you. Below are some of the questions that intrigued me or came up while trying to fine-tune LLMs. …AI34 min readAI34 min read
Published inBetter ML·PinnedImage pre-processing for TF Serving via OpenCV, Pillow, TensorFlow tf.image.decode* , Keras-Retinanet ExampleExample Input Images (all images are attributed to their owners, just showing here for technical demo)Image Processing10 min readImage Processing10 min read
Published inBetter Software·PinnedOptimizing any TensorFlow model using TensorFlow Transform Tools and using TensorRTModel Optimization and reducing precision from FP32 to FP 16 for speedup and reducing graph size. — What is this article about? Whom is this meant for? More than an article, this is basically how to, on optimizing a Tensorflow model, using TF Graph transformation tools and NVIDIA Tensor RT. This is a bit of a Heavy Reading and meant for Data Science Engineers than Data Scientist. …TensorFlow19 min readTensorFlow19 min read
PinnedBackpropagation Deep DiveBack Propagation with Softmax output and CrossEntropy Loss — Update — Please see the updated one at https://alexcpn.github.io/html/NN/ml/8_backpropogation_full/ The internet is teeming with articles explaining Backpropagation. Why one more? Well, I set out to understand this and thought I understood this, having derived out one and done a toy example too. But then I tried to code a simple…Backpropagation9 min readBackpropagation9 min read
Published inBetter Software·PinnedFrom Data Warehouse to Data Lake to Data LakehouseWhat’s for what, what you need, and what are the advantages and limitations — Before we go to Data Lake we need to go through the other Data Store technologies, to see the full picture and to understand, what has changed and what has not. …Data Science14 min readData Science14 min read
Published inalexpunnen·Nov 4Meditation my first weekWell, I stumbled on meditation a few weeks before my 46th birthday. So yes I started too late and no, I know nothing. Still, I thought that I could document my journey as it would be interesting to look back later. This may be the worst place to read about…Meditation4 min readMeditation4 min read
Published inalexpunnen·Nov 4Let’s remember Edith Cavell TodayThe novelty of everything wears off fast in these times; the war in Ukraine and Russia is headlines no more. Though it is still very fresh the Israel-Hamas war is no longer in the headlines. Still, this has generated enough hate between large groups. And the most evil and sad of this is hate. So maybe this is as good a time to remember someone like Edith Cavell https://en.wikipedia.org/wiki/Edith_CavellHate1 min readHate1 min read
Published inalexpunnen·Oct 21A Hackers Guide to HateOn Why we hate ? And the hard solution. — A trip to Twitter/X is more than enough to prove empirically, that what we have plenty in this world is Hate. It is said that the Sun provides enough energy per day as Sunlight that if converted could power generation. …Hate3 min readHate3 min read
Published inalexpunnen·Oct 15Meditation is AwarenessWhy is this so important to start practising this art — Like the vast majority of people out there, I never ever thought or practised meditation. It’s forty-five years now and I have never spent a minute on this. I see what I have missed now. I started practising this briefly a few weeks back. Its benefit is truly amazing. …Meditation7 min readMeditation7 min read
Published inTowards AI·Sep 5Exploring Large Language Models -Part 3Fine-tuning, Model Quantisation, Low Ranked Adapters, Instruct Tuning and using LLMs to generate training data — Below are some of the questions that intrigued me or came up while trying to fine-tune LLMs. The article is an attempt to understand these and share this understanding with others in a lucid way, along with deep dives and code illustrations for advanced users. This article is split into…AI17 min readAI17 min read
