Writing
Thoughts on machine learning, LLMs, and building things that work.
Weights & Biases Reports
Technical articles and tutorials I’ve written on the W&B platform—covering deep learning, computer vision, LLMs, and practical ML engineering.
LLMs & RLHF
- Understanding Reinforcement Learning from Human Feedback (RLHF): Part 1
- An Introduction to Training LLMs Using Reinforcement Learning From Human Feedback (RLHF)
- How to Evaluate, Compare, and Optimize LLM Systems
- Building Advanced Query Engine and Evaluation with LlamaIndex and W&B
- Implementing RLHF: Learning to Summarize with trlX
- RLHF: Hyperparameter Optimization for trlX
Computer Vision & GANs
- Towards Deep Generative Modeling With Weight & Biases
- How to Evaluate GANs using Frechet Inception Distance (FID)
- Train Generative Adversarial Networks (GANs) With Limited Data
- In-Domain GAN Inversion for Real Image Editing
- An Introduction to Adversarial Latent Autoencoders
- Interpretability in Deep Learning With Weights & Biases: CAM and Grad-CAM
- An Overview of Instance Aware Image Colorization
- Image Segmentation Using Keras and Weights & Biases
- Object Localization With Keras and Weights & Biases
- Image Classification Using Vision Transformer and KerasCV
PyTorch & PyTorch Lightning
- How To Use GPU with PyTorch
- How to save and load models in PyTorch
- How To Check If PyTorch Is Using The GPU
- Image Classification Using PyTorch Lightning and Weights & Biases
- Transfer Learning Using PyTorch Lightning
- Multi-GPU Training Using PyTorch Lightning
- An Introduction To The PyTorch View Function
- PyTorch Dropout for regularization - tutorial
- Implementing and Tracking the Performance of a CNN in PyTorch
Keras & TensorFlow
- Keras Dense Layer: How to Use It Correctly
- Input Keras Layer Explanation With Code Samples
- Batch Normalization in Keras - An Example
- How to Use Cosine Decay Learning Rate Scheduler in Keras
- Using GPUs With Keras: A Tutorial With Code
- Integrating Keras with Weights & Biases
- How To Install TensorFlow With GPU Support on Windows
- How to Prevent TensorFlow From Fully Allocating GPU Memory
- LSTM RNN in Keras: Examples of One-to-Many, Many-to-One & Many-to-Many
- A Guide to Multi-Label Classification on Keras
HuggingFace & Transformers
- How To Fine-Tune Hugging Face Transformers on a Custom Dataset
- Examples of Early Stopping in HuggingFace Transformers
- SimpleTransformers: Transformers Made Easy
- Taming Transformers for High-Resolution Image Synthesis
Deep Learning Fundamentals
- What’s the Optimal Batch Size to Train a Neural Network?
- ReLU vs. Sigmoid Function in Deep Neural Networks
- How to Handle Images of Different Sizes in a Convolutional Neural Network
- Intuitive understanding of 1D, 2D, and 3D convolutions in convolutional neural networks
- What’s the Difference Between Strided Convolution and Pooling?
- Comparing Sigmoid-MSE With Softmax Cross-Entropy for Image Classification
- How One-Hot Encoding Improves Machine Learning Performance
- Understanding the Effectivity of Ensembles in Deep Learning
Data Augmentation & Training Techniques
- Modern Data Augmentation Techniques for Computer Vision
- Simple Ways to Tackle Class Imbalance
- Exploring Adaptive Gradient Clipping and NFNets
- Metric Learning for Image Search With Weights & Biases
- How to avoid checkerboard pattern in your generated images?
3D Vision & Novel View Synthesis
- 3D Image Inpainting With Weights & Biases
- Paper Summary: One Shot 3D Photography
- X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation
- Overview: Neural Scene Flow Fields (NSFF) for Space-Time View Synthesis of Dynamic Scenes
- Dynamic Sky Replacement: The Sky Is Within Our Grasp!
Video & Animation
- One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
- An Introduction to Egocentric Videoconferencing
- An Intro to Retiming Instances in a Video
- Automating Animations with the Help of Robust In-Betweening
Other
- Self-Supervised Learning with SwAV
- How To Use Weights & Biases With MMDetection
- Generating Digital Painting Lighting Effects via RGB-space Geometry
- An Overview of DeepFaceDrawing
- Rewriting a Deep Generative Model: An Overview
- From EMNIST to Wikisplit: Sentence Composition Using W&B
- Modeling Drivable Areas for Autonomous Vehicles with Real and Synthetic Data