Founder of Wisko · AI Researcher & Engineer

Turning research into systems
that work in the real world.

I work at the intersection of large language models, computer vision, and real-time voice AI. My undergraduate research built a Vision Transformer for plant-disease detection, and I now lead Wisko, a multi-tenant agentic SaaS platform. I'm seeking graduate research opportunities to deepen this work.

Portrait of Osama Altaf
Seeking graduate research opportunities
3.63/4.0CGPA, BS Physics (US 4.0 scale GPA 3.63)
7.5IELTS overall (C2 Listening & Reading)
1Vision Transformer thesis (cotton-leaf disease)
3International conferences organized
★ Founder & CEO

Wisko wiskoai.com

My company. Wisko is a multi-tenant SaaS platform where autonomous agents generate complete whiteboard-animation videos: applied agentic AI and multimodal generation running in production.

01 · About

Research interests & background

I'm an AI engineer with a physics background and a strong pull toward research. My undergraduate final-year project designed an Object Detection Transformer and an AI digital microscope to detect cotton-crop diseases from visual symptoms, bridging computer vision and real-world agricultural sensing.

Professionally, I build production LLM and voice-AI systems: multilingual real-time translation across 30+ languages, agentic workflows, and efficient inference via fine-tuning, KV caching, and quantization. I'm eager to bring this systems-and-research experience into a graduate program focused on LLMs, multimodal learning, or computer vision.

  • Research interestsLLMs · Vision Transformers · Multimodal & Voice AI
  • DegreeBS Physics (Computational), CGPA 3.63 / 4.00
  • EnglishIELTS 7.5 (C2 Listening & Reading)
  • LocationPakistan · open to relocation

02 · Education

Education & academic record

BS Physics, Computational Physics & Computer Programming

Khwaja Fareed University of Engineering & IT (KFUEIT), Pakistan · 2019 to 2023

CGPA: 3.63 / 4.00 (equivalent to a GPA of 3.63 on the US 4.0 scale) · EQF Level 6

Thesis: “Object Detection Transformer for disease detection on cotton leaves.” Field: Computational Physics, computer programming, mathematics & statistics.

Machine Learning, MLOps & LLM Zoomcamps

DataTalks.Club · 2023 (Remote, United States) · EQF Level 4

F.Sc. Pre-Medical (Intermediate)

BISE Bahawalpur, Pakistan · 2017 to 2019 · Final grade: 89%

Matriculation (Secondary School)

BISE Bahawalpur, Pakistan · 2015 to 2017 · Final grade: 95%

Languages

EnglishIELTS 7.5, with C2 Listening and Reading and C1 Speaking and Writing
UrduNative

03 · Research & Projects

Research & technical projects

Vision Transformer for Cotton-Leaf Disease Detection

Final Year Research Project · Computer Vision

Designed an Object Detection Transformer and an AI-modeled digital microscope to detect cotton-crop diseases from visual symptoms, outperforming traditional CNN baselines in classification accuracy.

  • Vision Transformer
  • Object Detection
  • AgriTech

Airport Vehicle Detection: Vision vs. LiDAR

Freelance research study · UK

A benchmarking study carried out for a UK-based student that evaluated a wide range of computer-vision models for detecting vehicles at airports. The core question was whether camera and vision-based systems could replace LiDAR by estimating depth, distance, and detection quality across changing lighting, seasons, and weather.

  • Computer Vision
  • Model Benchmarking
  • Depth Estimation
  • LiDAR vs Vision

Real-Time Multilingual Voice Translation

GovTech Research · Speech & LLMs

Bi-directional voice translation across 30+ languages at sub-1500 ms latency, combining Whisper ASR, custom speech pipelines, and context-aware memory for cross-language consistency.

  • Whisper
  • LiveKit
  • Context Memory

Secure Enterprise RAG Knowledge Base

Retrieval-Augmented Generation

A privacy-preserving document assistant on local Llama 3 and Qdrant, enabling semantic search over large corpora with no external data leakage.

  • RAG
  • Local LLM
  • Vector DB

Autonomous Multi-Agent Analyst Swarm

Agentic Systems · CrewAI

A swarm of autonomous agents that gather information, run sentiment analysis, and synthesize structured reports, featuring self-correction loops and tool use.

  • Multi-Agent
  • CrewAI
  • NLP

Edge-AI Vision on NVIDIA Jetson

Embedded Computer Vision

Deployed lightweight YOLOv8 models on Jetson Orin Nano for real-time detection at <40 ms fully-offline inference in low-bandwidth environments.

  • Edge AI
  • YOLOv8
  • Real-Time

Physics & IoT Hardware Projects

Instrumentation & Sensing

Portable Raspberry Pi radar for remote sensing with real-time signal processing, plus IoT safety systems including a blind-spot accident-prevention module and gas-leakage detector.

  • IoT
  • Signal Processing
  • Raspberry Pi

Vision-Language Fine-Tuning on Radiography

Multimodal ML · VLM

Fine-tuned Llama 3.2 Vision with Unsloth on radiography imagery, adapting a vision-language model to medical image understanding.

  • Vision-Language
  • Medical Imaging
  • Fine-tuning

LLM Fine-Tuning Pipeline

LLMOps · Unsloth + LoRA/QLoRA

An efficient fine-tuning pipeline using Unsloth with LoRA and QLoRA for domain-specific LLM adaptation on constrained hardware.

  • LoRA
  • QLoRA
  • Unsloth
  • LLMOps

Stable Audio 3 → ONNX Pipeline

Diffusion models · Inference

An open-source pipeline that exports Stability AI's Stable Audio 3 Small (music & SFX) diffusion transformer to ONNX, so it runs CPU/GPU inference without a PyTorch runtime dependency.

  • Diffusion
  • ONNX
  • Audio Generation

Orpheus Assistant

Agentic AI · LLM orchestration

An AI assistant built with LLM orchestration, tool use, and conversational memory for multi-step, context-aware reasoning.

  • Agents
  • Tool Use
  • Memory

YouTube Automation Pipeline

Multimodal systems · LangGraph

A LangGraph-orchestrated pipeline generating script → TTS → images → whiteboard sketch animation, stitched with FFmpeg and served via FastAPI + APScheduler on Supabase & GCS, running as a full multimodal generation system.

  • LangGraph
  • Multimodal
  • FastAPI

Code & write-ups on GitHub →

04 · Skills

Technical toolkit

Machine Learning & CV

  • Transformers
  • Vision Transformers
  • Object Detection
  • Fine-tuning
  • Vision-Language Models
  • PyTorch

LLM & Generative AI

  • RAG
  • Quantization
  • KV Cache
  • Prompt Engineering
  • Hugging Face
  • vLLM

Agents & Frameworks

  • LangChain
  • LangGraph
  • CrewAI
  • AutoGen
  • PipeCat
  • LiveKit

Voice AI & Audio

  • Whisper ASR
  • STT / TTS
  • WebRTC
  • Real-time Telephony

Engineering & Data

  • Python
  • FastAPI
  • Redis
  • Docker
  • Pinecone
  • Weaviate
  • Qdrant

Scientific Foundations

  • Computational Physics
  • Mathematics
  • Statistics
  • Signal Processing

05 · Experience

Professional experience

Jul 2025 to Jan 2026

AI Engineer, LLM Systems Research & Analyst

Contract · Remote · London, United Kingdom

  • Deployed and scaled large language models for smart assistants and task automation.
  • Used vLLM for high-throughput, low-latency inference with efficient KV cache use.
  • Integrated multi-agent orchestration (AIBrix) to coordinate tools and APIs into goal-driven workflows.
  • Fine-tuned LLMs on proprietary datasets and built FastAPI services with LMCache and Redis caching.
  • vLLM
  • Fine-tuning
  • FastAPI
  • Redis
Feb 2025 to Jun 2025

AI Voice Agent Developer & Research Analyst

Government Real-Time Translation System · Confidential GovTech · Remote · Morocco

  • Co-developed a real-time multilingual system with bi-directional translation across 30+ languages.
  • Integrated Whisper ASR with custom pipelines at sub-1500 ms latency (LiveKit, PipeCat).
  • Engineered context-aware memory modules for cross-language conversational consistency.
  • Whisper
  • LiveKit
  • PipeCat
  • WebRTC
Nov 2024 to Feb 2025

AI Engineer, Voice AI Agent Platform

US Project · Remote · Miami, United States

  • Designed a scalable Voice AI platform supporting inbound/outbound telephony via SIP trunk routing.
  • Integrated LangGraph-powered agents for context-aware, multi-turn conversations.
  • Hardened STT/TTS pipelines for production reliability.
  • LangGraph
  • SIP
  • Voice AI
Apr 2023 to Feb 2024

Junior AI Engineer & Business Development (Intern)

iAxon Software House · Pakistan

  • Optimized model-training workflows, cutting compute time 30% via feature engineering.
  • Built Python predictive-modeling solutions, improving forecasting accuracy 15%.
  • Conducted market analysis that drove a 10% increase in client acquisition.
  • Python
  • ML
  • Feature Engineering

06 · Certifications

Certifications & continuing education

  • Fine-Tuning Large Language ModelsDeepLearning.AI
  • LLMOps: Deployment & InferenceDeepLearning.AI
  • Building AI Voice Agents for ProductionDeepLearning.AI
  • Practical Multi AI Agents with CrewAIDeepLearning.AI
  • AI Agentic Design Patterns with AutoGenDeepLearning.AI
  • Evaluating AI AgentsDeepLearning.AI
  • Vector Databases: From Embeddings to ApplicationsDeepLearning.AI
  • LangChain for LLM Application DevelopmentDeepLearning.AI
  • Mastering Generative AI: Agents with RAG & LangChainedX · IBM
  • MLOps & LLM ZoomcampDataTalks.Club

07 · Service & Leadership

Academic service & leadership

Conference Organizer

ICPSE-2021 & ICPSE-2022 (International Conferences on Physical Sciences & Engineering) and ICSMAND (9th International Conference on Semiconductor Materials & Nano-Devices).

Society President

President, Natural Resources Defense Council & Society, KFUEIT.

Science Outreach

Organized the 1st South Punjab Science Mela 2021; participant in the World Water Day webinar on renewable-energy water electrolysis.

University Service

Student Proctor at the 1st KFUEIT Convocation; organized a Blood Donation Camp at Sehja Public Health Care Centre.

08 · Contact

Reach out about research opportunities

I'm seeking graduate research and MS/PhD opportunities in AI. I'd be glad to share my full CV, transcripts, or code. The best way to reach me is email. Copy it below, or click to open your mail app.

osamaaltaf.pk@gmail.com