Himansh Raj

Projects

Research & Applied AI Projects

Small Language Model

Built a lightweight transformer model (~100k params) to analyze next-token prediction behavior under constrained model capacity. Explores how minimal architectures learn token distributions and where they fail.

PythonPyTorchTransformersTokenization

Vision Language Model

Developed a lightweight image projector to align visual features with text embeddings for analyzing multimodal LLM representation learning. Studies how visual-textual alignment emerges in small-scale models.

PythonPyTorchNeural NetworksMultimodal

Infinite Context LLM (Ongoing Research)

LLM/SLM memory architecture with active and passive memory states enabling scalable, near-infinite knowledge retention and efficient contextual recall. Investigating long-range dependency handling beyond standard context windows.

PythonTransformersMemory ArchitectureResearch

3DWebAi — Fine-tuned LLM

Fine-tuned and aligned Meta-Llama-3-1.8B-Instruct using Unsloth and TRL to generate React Three Fiber 3D scenes. Evaluates instruction-following fidelity in domain-specific code generation tasks.

Llama-3UnslothTRLHugging Face

Doremon — EEG Smart Home

Brain-signal-controlled home automation using EEG signals to toggle appliances and multimedia via fixed-frequency flickering stimuli. Built both hardware and signal-processing pipeline. Hackathon winner.

PythonIoTEEGSignal Processing

BlackTable — LLM-based Analysis Toolkit

API for resume parsing, candidate-job fit scoring, and interview question generation using RAG and LLM pipelines. Evaluates reliability and robustness of LLM-based document understanding.

PythonFastAPIOpenAIRAGDocling

8085 Microprocessor Simulator

Complete 8085 emulator with 64KB addressable memory, step-by-step debugging, and multiple input modes (binary, hex, mnemonic). Studies low-level instruction execution and processor state transitions.

C++AssemblySystem Design

Other Projects