farhan syed

* Architected & implemented rules engine used by DARPA for massive data collection & aggregation across public networks (Facebook, Twitter, Youtube, and others) * Maintained & supported machine learning analytics pipeline that annotated and scored based on DARPA models * Designed multiple GRPC protocols to be used with rules engine to allow collector registration * Designed & implemented Twitter streaming data collection service using gRPC bi-directional streaming * Supported devops infrastructure work by creating health check endpoints across multiple projects * Instrumented metrics and stats across the entire ecosystem pipeline to determine bottlenecks, error rates, and timings * Ran high volume experiments to determine 3rd party token usage for performance tuning and banning rates * Refactored multiple legacy code bases for test coverage, and general coding standards * Coordinated protocol changes, and development strategies with multiple 3rd companies for DARPA integration * Advocated for agile processes; Ran sprint planning meetings, backlog grooming, and retrospectives

* Developed an ontology model for internal graph database (Athena), implemented basic graph algorithms (BFS, DFS) across a database with over 1 billion nodes in a streaming paradigm * Architected & performance-tuned an ingestion service with Akka that took TBs of data, generated graph models, and deduplicated before inserting them into HBASE * Developed internal CLI tools to orchestrated cluster synchronization, end to end testing, and incremental backups * Implemented security systems for sensitive data that met the requirements of FDIC regulations * Prepared & architected deployment strategy for many apps within our cluster using Docker and Terraform * Created instrumentation to assess and debug bottlenecks within the ingestion pipeline * Ran retrospectives, spring planning meetings, and mentored Junior Engineers on Testing Principles

Was hired as a automated test engineer. Moved AKQA testing from a manual process to an automated workflow. Wrote User Stories, Test Cases, and Test plan for many large brands (Volkswagen, Delta, Nike, BethSoft. For client specific tasks see below.

* Worked on and Deployed real-time activity stream service, designed an Entity Graph that unified all the disparate data models in numerous web applications at the society * Refactored, Extended, membership API, and created a society wide CORS package * Worked on Single Sign On service at the society * Worked closely with product managers to generate user stories, functional test cases, and minimum viable products * Extended ETL migrations for the marketing data warehouse

Worked primarily as a Django developer. Helped clients migrate to a modern CMS, worked on data migrations, and helped establish Django standards across various client projects. For more specific tasks see below:

* Architected and Deployed several Micro-services on AWS using Docker, CoreOS, and Consul * Architected and Deployed streaming ETL pipeline to dedupe entire content datastore using Kafka * Prototyped Twitter Storm + Kafka data pipeline architecture * Created an MDM (Master Data Management) process to reconstruct the content data model * Internal Tools to unify metrics and events across our ecosystem using dogstatsd * Automatic elastic search cluster snapshotting * Web Hook micro-service to restart key pieces of in our data pipeline