Peter V.

🚀 Implemented Terminal-Bench / Harbor alignment benchmarks for LLM training that consisted of creating an oracle solution (e.g., a working program that solves a real-world problem), prompts that instruct an LLM agent (i.e., recent versions of Anthropic/Claude, OpenAI/GPT, and Google/Gemini) how to implement the solution, and test cases that verify that the LLM agent was able to create a solver / program that passes the test cases. Modified each of the three components to ensure near perfect alignment while maintaining realism in the scenario. Projects included typical software and data engineering problems such as: ⮚ Telemetry dimension cardinality explosion detection ⮚ JSON schema diff breaking changes ⮚ ETL data pipeline compliance ⮚ SQL data lineage and dependencies ⮚ Airflow 3.x DAG batch prediction ⮚ System uptime status and reports ⮚ Transactional velocity profiling for financial accounts 🚀 Implemented Python tooling to submit local and remote benchmarks, measure alignment quality, and provide detailed feedback for alignment improvements in markdown format using local and remote LLMs.

🚀 Provided expert Rust feedback and training for LLMs by reviewing Rust commits across many repositories and providing feedback on LLM implementation quality with respect to the commit issue statement. Top performer.

🚀 Ad Tech: Membership Db and Audience Services ⮚ Improved robustness and stability of MNTN's ad targeting system prior to their successful IPO. Reverse engineered lightly documented Rust code interfacing with a RocksDB backend and Kotlin gRPC pipeline leveraging Protobuf, Kafka, and jq. Debugged panics due mostly to FFI and pinned memory requirements for the RocksDB API leveraging lldb. ⮚ Prototyped an asynchronous cache service in Rust that receives updates over configurable streaming gRPC/Protobuf endpoints. The service supports an in-memory cache backed by local sharded storage (RocksDB) to improve resilience. 🚀 Ad Tech: Targeting ML Experimentation ⮚ Curated data for ML engineering and data science team experiments.

🚀 Product and Business Reporting for Office.com / Microsoft365.com ⮚ Led the product and business reporting pipeline for Office.com, including telemetry schema specification, compliance, design, implementation, and at least two schema migrations. ⮚ Led a team of 20 engineers to comply with GDPR requirements under a tight deadline. ⮚ Mentored engineers on other teams so that they could establish their own similar data pipelines. ⮚ Delivered an innovative pipeline, prioritizing lower cost, that included telemetry schema management and code generation of SQL scripts and Azure artifacts for tracking core product and leadership metrics and cubes for DAU/MAU and Cohort Retention across multiple dimensions. Influenced org-level pipelines following a similar pattern. ⮚ Participated in DRI on-call rotation for Office.com front-end service including debugging service-related deployments, issues, and escalations ⮚ Led DRI on-call rotation for the Office.com data pipeline ⮚ Leveraged T-SQL/C#, Azure Data Lake Storage, Azure Data Lake Analytics, Synapse, Spark, Azure SQL, Kusto / Azure Data Explorer, and Power BI using DAX. 🚀 Privacy and Compliance for Office.com / Microsoft365.com ⮚ Led the privacy compliance program for all features appearing on Office.com / Microsoft365.com. Authored and maintained the DPIA for Office.com, ensured privacy compliance, handed internal and external escalations, and wrote privacy policy guidelines at the organizational level. Also created PowerPoint templates for Privacy and Compliance reviews, and Threat Model templates for Security reviews. ⮚ Led a privacy and security audit for an external vendor to determine if we could leverage their services in a compliant manner consistent with internal Microsoft policies. ⮚ Led feature teams through privacy, security, and compliance reviews ensuring that that compliant features are successfully designed and shipped in a timely manner.

🚀 Application Distribution Platform ⮚ Led and coordinated teams distributing pre-release desktop and mobile applications internally across the Office organization. ⮚ Architected, implemented, and administered a full-stack application distribution platform for over 100 Microsoft teams and 30% of all Microsoft employees with features including self-service onboarding, branded landing pages, SMS download links, and anti-virus scanning. ⮚ Later led the migration of the platform to HockeyApp, now known as Visual Studio App Center, including coordinating teams, initial integration / dual-deployments, and then the final deprecation -- without any incidents. ⮚ Leveraged C#/.NET, JavaScript, Bootstrap Azure Storage, Azure Service Worker, Entity Framework, SQL. 🚀 Bing Developer Experiences ⮚ Designed and implemented ingestion pipelines for third-party data using Transact-SQL, C#/.NET, and Entity Framework, and SQL Client. 🚀 Speech Components Group and Speech SDK ⮚ Led and implemented in-process test automation for a grammar tool utilizing Text Normalization/ Inverse Text Normalization across 26 languages. ⮚ Led and implemented testing for the Extensible Multimodal Annotation, EMMA markdown language. 🚀 Windows Live Spaces ⮚ Top bug finder for Shared Spaces and second top bug finder for all of Windows Live ⮚ Globalization, Localizability, and Accessibility champion 🚀 Ohana Family Calendaring V1 ⮚ Implemented an in-process test automation framework using C# and Win32 APIs ⮚ Implemented a calendar control using client-side generated JavaScript and CSS ⮚ Nominated for CPXX Award by Rogers Weed, GM ⮚ Presented finding to Tom Gibbons, VP • C#, .NET, Win32 APIs, ASP.NET, JavaScript, CSS • Windows, Web

🚀 Global Perpetual Inventory | Supply Chain ⮚ Significantly increased sales and reduced costs by implementing the 'Little Red Button' to migrate fulfillment away from fulfillment centers having critical issues. Prior to the implementation of this feature Fast Track next day delivery had to be turned off across the entire Amazon website. After the implementation Fast Track could be turned on/off at the product / warehouse / inventory owner group level instead. ⮚ Leveraged Oracle SQL and Perl ⮚ Significantly improved inventory cycling and sellable inventory ratios at Amazon fulfilment centers by finding, investigating, and then fixing an issue that was causing some products to become unavailable for sale forever due to being incorrectly encumbered. This was known as the 'ghost inventory' issue. ⮚ Leveraged Oracle SQL and Perl ⮚ Led coordination of supply chain teams launching new Amazon fulfillment centers worldwide almost doubling the number from the previous year. I was the only leader able to reliably deploy these fulfillment centers without also creating a SEV-1 incident. ⮚ Designed the logical and physical database models for a Website Availability Monitor. Also implemented significant portions of the pub/sub, Mason, and SQL code for same. ⮚ Participated in the on-call DRI rotation including handling deployments, Oracle database administration, distributed systems support, investigation of services written in C++, telemetry and order pipeline issues, and a variety of on-the-box issues. • C++, Perl, SQL, Database modeling • Linux, Web

🚀 Auto-Tune for Windows | Antaras Audio Technologies ⮚ Implemented the very first Auto-Tune Windows port of the ever-popular Auto-Tune pitch-adjustment audio plug-in for Mac leveraging DirectX, C++, COM, and DirectShow Transform Filters, including the installer, and leading the beta program. 🚀 USB Audio Drivers for Mac | M-Audio ⮚ Implemented low-latency USB audio drivers for over half a dozen M-Audio Pro USB products leveraging Objective-C and Embedded C++. ♫ Audiophile USB ♫ USB Duo ♫ MobilePre USB ♫ OmniStudio USB ♫ Ozone ♫ USB Quattro ♫ Transit USB ♫ Sonica Theater 🚀 Click’N Design 3D for Mac | STOMP, Inc. ⮚ Implemented a C++ engine to parse TrueType and OpenType fonts, render them in 3D leveraging OpenGL, and interactively apply various transformations and mappings to them (e.g. warping via Bezier curves, lighting, image mapping, etc.). Also worked on the following projects: 🚀 Anti-virus library for Mac 🚀 Guitar instruction application for Windows

🚀 Magic the Gathering: Battlemage for Windows and PlayStation | Acclaim ⮚ This rendition of Magic the Gathering consisted of top-down animated renderings of wizard and creatures battling in a 3-D world, casting spells, traveling to opponent wizard territories, and battling against each other in real-time. ⮚ Implemented the creature hand-to-hand combat & spell AI state machines in C. ⮚ Implemented a cross-platform continuous delivery pipeline used by artists and developers in C++. ⮚ Implemented the palette-cycling engine used for the dynamic environmental intro scenes. ⮚ Led technical communications with Acclaim to ensure product alignment and delivery. 🚀 Crusader: No Remorse for PlayStation | Electronic Arts, Inc. | ORIGIN Systems ⮚ This game depicted a crusader battling through 2 ½ D isometric levels. ⮚ Ported the 8 MB Windows object-oriented version of the game written in C++ to a 2 MB + 1 MB VRAM PlayStation implementation written in C. ⮚ Designed and implemented the 2 ½ D isometric display engine. ⮚ Implemented game-specific audio libraries, a video RAM manager, and a memory manager in C. 🚀 Elmo’s Letter Adventure, Elmo’s Number Journey for PlayStation | NewKidCo ⮚ Implemented 3D camera movements (i.e., following Elmo as he travels through the world, and also dynamically panning and focusing on different Sesame Street characters as they talk to the player) ⮚ Implemented game-specific XA-Audio, MIDI, and other audio libraries in C ⮚ Implemented the HUD ⮚ Led technical communications with NewKidCo regarding product alignment and delivery. 🚀 Wild Wild West ⮚ Implemented a novel menu system including dynamic creation of moving menu components leveraging a steam-punk aesthetic ⮚ Implemented the HUD