Kirsten Liu
Data Engineer @ LAist
About
Specialties: Golang, Python, C#, C, Perl, Regex, MySQL, Bash, Docker; GCP, AWS; Software developing, Data pipeline, ETL, Scripting, Data mining, Big data, Automation, System testing/monitoring, CI/CD, Quality Assurance; Violin, Piano
United States
Pasadena
Computer Software
Data Services, Data Build Tool (DBT), SQL, Google Analytics, GraphQL, Google BigQuery, Programming, Go (Programming Language), Python, Pandas, Jupyter, Apache Airflow, Docker, Google Cloud Platform (GCP), MySQL, PostgreSQL, RabbitMQ, Redis, YAML, gRPC
Experience

Data Engineer
Pasadena, California, United States
● Develop APIs in Go with third party API like Omny, county and state election native API, chartbeat API and Grove graphQL, hosting natively on Google cloud console along with Docker containers to provide customized enriched data and ensure data delivery and data integrity. Reduce manual effort from 90% to 0% by providing 100% automation to generate reports in Go. ● Leverage Google APIs including but not limited to Google sheet API, Google drive API, Google Analytics Data API, and BigQuery API on both Go and Python to provide customized ETL for data in specific domains, i.e. audience engagement, website analytics and newsletter reach. ● Create and maintain dashboards in Google Looker Studio, by generating data sources from BigQuery and Google Analytic, combined with SQL scripts to deliver data analytic insight and data visualization for wider audiences like leadership and marketing teams. ● Incorporate Selenium, UI Vision and Playwright in Python script to automate manual process of collecting data on 3rd party webpages, wrapped up with Flask as a web service to be self hosted on Docker and GCP with cron trigger, and on Windows10 AWS workstation with batch file and Windows task scheduler

Data Engineer / Backend Developer
Taipei City, Taiwan
As Pickupp first Data engineer, I work on both ETL optimization and server architecture. My jobs includes but not limited to ● come up with a dataflow diagram with all the services Pickupp uses (AWS S3, Postgres, Prometheus, Tableau...just to name few) from architecture point of view ● monitor and maintain AWS DMS, plus create APIs in Golang to offer automation to delete data during specific period or passed TTL(time-to-live), hosting completely on Docker with providing custom Yaml in Base64. ● find weak spots in ETL and data pipeline to improve by talking to cross team members and doing survey to existing systems ● create script using Metabase API to inventory mass amount of SQL queries created by sales and marketing teams ● set mobile data monitoring with Flurry and maintain already established Google Analytics for both data on mobile and website ● clean up backend data on Postgres, bringing Airflow into data pipeline, suggest and test how the deployment should be

Freelance Programmer
Taipei City, Taiwan
Make Python and Go automation for Youtube data analytic on GCP(Google Cloud Platform) API to export data into google sheet with pre-defined columns. The data cover the datetime, title and duration of the video, views, comment, like numbers, etc. from list of channels as requested.

Software Developer
Vancouver, Canada Area
● Develop API and features in Go and Python for a data analytic pipeline of wind farms ● Build interoperable microservices in Go and Python with a compatibility layer to support the legacy monolithic architecture ● Provide automation solutions in Go and Python to optimize the process of bringing the specific data format including SCADA through different data collection strategies ranging from email to AWS Redshift into the existing platform ● Update database through MySQL script and Liquibase schema to onboard new customer and import enhanced data ● Test and deploy services on AWS using Docker, automated through CircleCI for unit and integration tests ● Manage issue escalation automation to guarantee data integrity and business intelligence ● Improve upgrade process and automate scheduled backup of Tableau (data visualization SaaS) server, upgrade AWS RDS with multiple properties and parameter groups to provide healthy data pipeline ● Give talks and represent Clir on different occasions like SCWIST

Sustaining QA Engineer / SDET
● Responsible for Splunk maintenance release / patching on distributed environments ● Specialize on CLI, REST, KVstore, distributed search, Search Head Clustering testing ● Manage customer cases and escalation ● Review test coverage to develop automation for functional, regression, performance and security tests ● Develop test automation with Pytest, triaging on Continuous Integration Systems, Jenkins and Bamboo, running on both Linux/Windows environment ● Focus on backend and search command, also in large deployment and scripting. Cover most tests in Python, but also work with Bash, REST call and JSON frequently, and some Perl and Regex

TA, Master Student
NTHU
Master Study of Computer Science National Tsing Hua University, Hsinchu, Taiwan Embedded System Lab, under Professor Jane Win Shih Liu Attended earning 24 credits toward Master's Degree until September 2015 Overall GPA 3.73/4.3 Fields of study: Real-time Scheduling, Embedded System, Natural Language Processing and Medication Specification Parsing

Master Project Part Time Developer
Project experiences ● Medical Direction Parser for Online Pharmacopoeia (MeDPOP) 2012 – 2015 Create a tool parsing medication directions written in natural language contained in online pharmacopoeias into specific format that is machine readable, Project SISARL (Sensor Information Systems (Services) for Active Retirees and Assisted Living), Academia SINICA Focus on NLP, N-gram parsing, Regular expression, web page crawler and Perl ● Two-level end-to-end scheduling service 2011 – 2012 Develop a service ensuring the timing constraints of real-time components which supports common end-to-end slack distribution strategies at the higher level and fixed priority scheduling at the lower level based on Microsoft Windows .NET Workflow Foundation, Project RARMS (Robotic Applications Resource Management Service), Industrial Technology Research Institute (ITRI) Focus on .NET workflow Foundation, priority scheduling, C# and multithreading ● Survey and implement with Windows Multimedia Class Scheduler Service 2010 – 2011 Implement features with Microsoft technical documentation to schedule real-time components by using fixed priority scheduling supported by the operating system Evaluate performance of using MMCSS, research and draw block diagram and call graph of codebase of previous projects, Project RARMS, ITRI Focus on MMCSS, .NET framework and priority scheduling

Intern
Galaxy Software Services Corporation (GSS)
● Development and research of XPS to PDF converter ● Black-box test of Electronic Official Documentation System
Education
Kirsten Liu's Contact Information
Phone
Find the Right Leads
Find Verified Contact Data
What LeadContact does well
Find verified emails, phone numbers, and decision-makers with 98% accuracy.
Find Leads
Find the right people by company, role, industry, location, and more.
925M+ professional profiles

Find Emails
Access verified email addresses for your target contacts.
657M+ emails

Find Phone Numbers
Get cross-validated phone data from multiple top sources.
239M+ phone numbers

More Accurate. Lower Cost.
Find contact data in 1 tool with 98% accuracy
LeadContact integrates leading enrichment tools to deliver more accurate contact data—without paying for each one.
Great conversations start with the right contact.
It’s time to find yours.



