3+ years of experience architectecting engineering solutions with big data/Hadoop and Cloud technologies – Spark, Hive, Flink, Presto, Snowflake, Map Reduce, YARN, and Amazon AWS.
Over a decade of professional experience planning, designing, and building data systems that integrate computer hardware, computer software, and communication technologies.
Completed
Projects
Years
of Experience
Awards
Winning
3+ years of experience architectecting engineering solutions with big data/Hadoop and Cloud technologies – Spark, Hive, Flink, Presto, Snowflake, Map Reduce, YARN, and Amazon AWS.
Developed MapReduce and Pig User Defined Functions (UDF) to mine, cleanse, and transform structured and semi-structured batch data to fit the business use case requirements.
Designed the architecture of an open-source Hadoop data lake and customer data hub with massively parallel real-time data processing capabilities and elastic hybrid cloud integration of data storage scalability. The secure architecture was also highly flexible and able to facilitate the governed delivery of both data science analytics, data warehouse modernization and master data management.
Developed an Omni Channel Hadoop/HDFS Data Lake Application, using Apache Ni-Fi and consuming Kafka pub/sub message queues of discretized streaming transactions, with in-motion analyses, governance, and storage distribution. Used Spark Streaming as the cluster's analytic engine, coupled with ElasticSearch, Amazon S3, and Cloudant for ad hoc scalability.
Built 18 total Hadoop cluster nodes, each with 50 TB of individual metal storage capacity with virtualized edge and test nodes, using the Hortwonworks HDP platform.
Developed ad hoc data analytic views for senior leadership, which demonstrated value using web-distribution via D3.js and Tableau.
Led the HBase and Spark analytics engine POCs, developing Hybrid Cloud architectures and testing performance on AWS, Cloud Foundry, and Google Cloud.
Credential ID 85C59A
Credential ID 310AB6
Credential ID 530D90
Credential ID 001763
Credential ID 617A0B
* Phi Theta Kappa Scholar Award (2014, 2015, 2016)
*Summa Cum Laude
*Phi Theta Kappa International Honor Society
© 2025 gerrychattman