Skip to content
View CDC1688's full-sized avatar

Block or report CDC1688

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
CDC1688/README.md

Anna Ning

AI research scientist — I train models and ship the systems around them.

My work runs from the architecture up: implementing transformers and optimizers from scratch, designing multi-task and meta-learning methods, and then putting those models into applications where accuracy has to survive contact with messy data.

First author on three papers at Stanford University, both with the code public and the results reproducible.


Research

Extending BERT with Multi-task and Meta-learning · Stanford CS 224N A single BERT encoder serving sentiment, paraphrase, and semantic similarity at once. Shared projected attention layers, Siamese sentence encoders with an early u−v interaction term, and Proto-BERT for few-shot classification. 74.0% average test accuracy, +20.4% over baseline — top 5 on the class leaderboard. Proto-BERT reaches 38.7% on a 5-way 5-shot out-of-domain meta-test. The transformer encoder and AdamW optimizer are implemented from scratch — no transformers.

TLDChoiceNet: Quantitatively Choosing a Transfer Learning Dataset · Stanford CS 330 Predicting how well a transfer-learning dataset will work before spending the compute to fine-tune on it. Cut prediction MSE 5×, and designed an unsupervised class-correlation metric that explains fine-tune accuracy with R² = 0.974 from a single forward pass — no training required. Along the way: evidence that ImageNet-pretrained weights actively push dissimilar classes apart in latent space.

Applied work

Project What it does
LangCrab Observability for LLM agents, built on LangSmith
Fake review detection Opinion-spam classification on Yelp — BERT, LightGBM, LSTM, CNN-LSTM and Naive Bayes benchmarked against each other. Fine-tuned BERT wins at 77.9% accuracy, 0.766 F1
3D image prediction Volumetric prediction from image data

What I work with

Modelling — Transformers, BERT, meta-learning (prototypical networks, MAML-style few-shot), multi-task architectures, transfer learning, CNNs, LSTMs, gradient-boosted trees

Engineering — PyTorch, TensorFlow/Keras, Python, LangSmith, TensorBoard, scikit-learn, LightGBM

The part people skip — reading the paper, implementing the method from scratch, and checking the result against a reference before believing it

Currently

Working on LLM agent observability, and interested in where meta-learning meets foundation models — how systems adapt to new tasks and domains from very little data.

Open to research collaborations.

Popular repositories Loading

  1. BERT-multitask-metalearning BERT-multitask-metalearning Public

    Extending BERT with multi-task learning and meta-learning — shared projected attention layers, Siamese sentence encoders, and Proto-BERT few-shot classification. Top 5 on the Stanford CS 224N leade…

    Python 1

  2. LangCrab LangCrab Public

    LangCrab - LangSmith agent observability

    Python 1

  3. TLDChoiceNet TLDChoiceNet Public

    Predict how well a transfer-learning dataset will work before fine-tuning on it. TLDChoiceNet cuts prediction MSE 5x, and an unsupervised class-correlation metric explains fine-tune accuracy with R…

    Jupyter Notebook 1

  4. CDC1688 CDC1688 Public

    Config files for my GitHub profile.

  5. NanoSim-H NanoSim-H Public

    Forked from karel-brinda/NanoSim-H

    NanoSim-H: a simulator of Oxford Nanopore reads; a fork of NanoSim.

    Python

  6. rgbd-plant-phenotyping rgbd-plant-phenotyping Public

    RGB-D plant phenotyping: predict lettuce fresh weight, dry weight, height, diameter and leaf area from paired colour and depth images. A geometry-to-biomass cascade network in PyTorch. Tencent Harn…

    Python