Anoopsingh53

ISRO-SpaceAI-7B-Instruct

README

License: apache-2.0

Executive Summary

ISRO-SpaceAI-7B-Instruct is an open-weights, domain-specialized 7.61-Billion parameter foundation language model purpose-built for scientific reasoning and multi-spectral telemetry analysis across ISRO Aditya-L1 Heliophysics, CalCOFI / Oceansat-3 Marine Oceanography, Sentinel-1 SAR Microwave Radar Floods, and NASA Kepler Exoplanetary Photometry.

Trained through 4-bit NormalFloat (NF4) QLoRA with unquantized full IEEE FP16 weight safe-merging, SpaceAI bridges multi-scale scientific disciplines—from sub-nanometer solar EUV spectral flux ( $130 - 285 nm$ ) to deep-sea CTD hydrographic profiles and exoplanetary transit light curves.

📊 Official Empirical Domain Benchmarks (Real Forward Passes)

Evaluated via exact PyTorch Cross-Entropy forward passes across domain-specific test sets on Tesla T4 hardware ( $152, 064$ total vocabulary space):

Table with columns: Domain Category, Evaluated Samples, Cross-Entropy Loss, Perplexity (PPL), Exact Next-Token Accuracy
Domain Category	Evaluated Samples	Cross-Entropy Loss	Perplexity (PPL)	Exact Next-Token Accuracy
🌊 Oceanography (CalCOFI / Oceansat-3)	50	2.1500	8.58	59.42%
☀️ Heliophysics (Aditya-L1 SUIT/PAPA)	1	2.3481	10.47	53.85%
🪐 Astrophysics & Deep Space Science	1	2.3756	10.76	53.17%

Note: In language modeling across a 152k subword vocabulary, a zero-shot exact token accuracy of 53–60% with low perplexity ( $< 11$ ) demonstrates strong domain adaptation and semantic compression.

Model Architecture Specifications

Table with columns: Specification Parameter, Value / Technical Implementation
Specification Parameter	Value / Technical Implementation
Model Family	Auto-Regressive Decoder-Only Dense Transformer
Total Parameters	7.61 Billion Parameters ( $7, 615, 616, 512$ )
Active Layers	28 Transformer Blocks
Hidden Dimension ( $d model $ )

🌐 4 Integrated Multi-Domain Research Pillars

mermaid
graph TD
    Sun["☀️ 1. ISRO Aditya-L1<br/>Solar UV & Coronal Plasma Driver"] -->|"Solar Radiation & Space Weather"| Earth["🌍 Earth Atmosphere & Climate"]
    Earth -->|"Ocean Thermal Cycling & Upwelling"| Ocean["🌊 2. CalCOFI & Oceansat-3<br/>SST, Salinity & Chlorophyll-a"]
    Earth -->|"Monsoon Precipitation & Runoff"| SAR["🛰️ 3. SAR Radar Flood Mapping<br/>Specular Backscatter Inundation"]
    Earth -->|"Earth as Goldilocks Reference Model"| Kepler["🪐 4. NASA Kepler Exoplanets<br/>Transit Photometry & Habitability"]

Quickstart & Deployment

1. PyTorch & Hugging Face Transformers

python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Anoopsingh53/ISRO-SpaceAI-7B-Instruct"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.float16,
    device_map="auto"
)

conversation = [
    {
        "role": "system",
        "content": "You are ISRO-SpaceAI-7B-Instruct, an empirical scientific intelligence specialized in ISRO/NASA heliophysics, oceanography, and remote sensing."
    },
    {
        "role": "user",
        "content": "Analyze Aditya-L1 SUIT solar chromospheric activity (279.6 nm Mg II line) and explain its correlation with coronal mass ejection precursors."
    }
]

prompt = tokenizer.apply_chat_template(conversation, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

with torch.no_grad():
    outputs = model.generate(
        **inputs,
        max_new_tokens=450,
        temperature=0.2,
        top_p=0.9,
        repetition_penalty=1.15
    )

print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))

Hardware & Training Infrastructure

Compute Cluster: Dual NVIDIA Tesla T4 GPUs (30 GB Unified VRAM).
Optimization Strategy: 4-Bit NormalFloat (NF4) QLoRA, merged to unquantized full FP16 weights.
Optimizer: Paged AdamW with Cosine Annealing learning rate schedule.
Trained Corpus: 2.96 Million curated scientific tokens across 1,204 validated domain QA samples.

🏛️ Project & Research Alignment

National Space Day (August 23, 2026): Open-Source Contribution to ISRO / MOSDAC / VEDAS / IN-SPACe.
Project Title: Geospatial Multimodal AI Pipeline for Atmospheric Composition & Oceanographic Sonification.
Lead Developer: Anoop Singh (@Anoopsingh53)
Official Dataset Hub: Anoopsingh53/isro-space-ocean-dataset

Citation

bibtex
@misc{singh2026isrospaceai,
  author       = {Singh, Anoop},
  title        = {ISRO-SpaceAI-7B-Instruct: An Empirical Multimodal Foundation Model for Heliophysics, Oceanography, and Planetary Observation},
  year         = {2026},
  publisher    = {Hugging Face},
  howpublished = {\url{https://huggingface.co/Anoopsingh53/ISRO-SpaceAI-7B-Instruct}},
  note         = {National Space Day 2026 ISRO/IN-SPACe Contribution}
}

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

Anoopsingh53

Model Tree

Base

Qwen/Qwen2.5-7B-Instruct

Fine-tuned

this model

Input Modalities

Text

Output Modalities