Zoya Goel

Developed PyTorch Matryoshka style training for sparse autoencoders and transcoders in EleutherAI’s sparsify repository; merged upstream; achieved comparable fraction of variance unexplained (≈0.095, GPT-2) to baseline. Enabled distributed training with PyTorch across multi GPU clusters, integrated training pipeline with EleutherAI CLT. Selected for EleutherAI Summer of Open AI Research (mentor: Gonçalo Paulo); Attempting to use autointerpretability techniques on hierarchically trained SAEs; training and analyzing vanilla vs. Matryoshka SAEs on GPT-2; cached activations and visualized coactivation patterns using UMAP, hyperbolic network layouts

Constructed synthetic Instagram DM dataset by applying chain of thought style transfer prompts to Reddit posts, labeling via keyword presence and K means clustering with semantic embeddings; verified alignment of synthetic and real DMs with UMAP. Designed and fine tuned Llama using PEFT, LoRA and DistilBERT models for loneliness classification; leveraged DeepSpeed/Accelerate and Optuna to parallelize hyperparameter tuning across 4 GPUs; few shot approach achieved ≈93% accuracy and F1 on labeled test data. Collaborated with University of Pittsburgh Medical Center researchers to run human evaluations on patient DMs; participants found outputs useful for identifying loneliness; Results submitted to PRISM Health Symposium.

Our research focuses on gender, science, and academia, and ways in which the participation and performance of women and men reflect and are affected by social and organizational features of science and academia.

- Holds weekly Small Group Meetings to help PLUS leaders improve their sessions and facilitate community building - Acts as a liaison between Tutoring and Academic Support Coordinators and PLUS Leaders - Handles clerical duties for other PLUS leaders (booking sessions, ensuring PLUS Leaders are fulfilling job requirements, etc.) - Conducts regular performance evaluations for other PLUS leaders

• Holds recitations twice a week for students taking Physics 2 at Georgia Tech. • Reviews key concepts taught in class, then helps students practice applying those skills. • Facilitates group study strategies and collaborative study techniques specific to the course. • Facilitates active learning during sessions

- Works to build community with residents by interacting with them individually and planning community-wide programming - Helps maintain the safety of the community by responding to incidents and occasionally being on-call for a day. - Assist with move-in and move-out.

1-to-1 Tutor - Tutoring and Academic Support, Georgia Institute of Technology (Fall 2022) Providing 1-on-1 tutoring services to students for classes with high enrollment. Completed a tutor certification program - learned how to teach more effectively, how to better build relationships with my peers. Courses Supported - CS 1331, CS 1332, MATH 2550, PHYS 2211, PHYS 2212 Physics Drop-In Tutor - Tutoring and Academic Support, Georgia Institute of Technology (Fall 2022) Staffing the Physics Help Desk, where students can drop in at any time to ask for help with PHYS 2211 or PHYS 2212. Learned how to more efficiently mentor and communicate concepts to students.

Responsible for running weekly studios, office hours, and grading for MATH 2550 (Introduction to Multivariable Calculus)

Worked on Fiserv’s Commercial Center project for managing transactions between financial institutions Developed microservices for file management for Commercial Center using Springboot (Java), PostgreSQL

French, Public Policy minors

A study abroad program offered through Georgia Institute of Technology