Dinesh Dandu has worked in the IT industry since 2010. From 2010 to 2014, they were a Software Engineer at ANZ, where they were involved in gathering business requirements and analysis of business use cases, developed MapReduce programs in Java for Data Analysis on multiple file formats, and minimized coupling between Presentation tier and Business tier with Spring IOC. From 2014 to 2017, they were an AWS/DevOps-BigData Engineer at Samsung Electronics America, where they designed the AWS Network to host Hadoop Clusters, designed and implemented the MangoDB production cluster, administered Linux severs, AWS services, and developed rest APIs by using Lambda & Flask framework, set up VPN connectivity to provide access for remote users, designed the CI pipeline to automate builds, provided best automate solutions by scripting in Python and Bash, and set up the continuous monitoring system on log files by using Splunk. From 2017 to 2018, they were an AWS DevOps Engineer at Intuit, where they were involved in the process of data acquisition, data pre-processing and data exploration to build data lake and provide possible architecting solutions by applying reliable tools and techniques, designed the automation pipelines & frameworks to provision Infra, EMRs and GPU clusters, and designed end to end Code deploy pipeline to deploy ETL applications, scripts and jobs. Currently, they are a Senior Data Engineer at DeepCrawl, where they are responsible for crawling client's websites and producing terabytes of data on every crawl job, and rendering the detailed dashboards and reports back to the client’s UI, as well as providing various features to the client like downloading reports, segmenting reports and archiving & unarchiving the old crawls. Dinesh is also responsible for a huge transformation process required in each crawl life cycle, once the front end app pulls the data into a data lake (s3), the transformation process starts performing the ETL activities and stores aggregated & processed data into Glue tables and exports the same data into Elastic search by Spark exports, this data from elastic search renders back to the client as visualized dashboards and reports.
Dinesh Dandu obtained a Bachelor's degree in Computer Science from Acharya Nagarjuna University. Dinesh then completed a Master of Science in Computer Science from 2015 to 2016. In addition, Dinesh obtained an AWS Certified Solutions Architect – Associate Level certification from Amazon Web Services in February 2017 and an Amazon Web Services Certified Developer – Associate certification from Amazon Web Services in December 2016.
Sign up to view 0 direct reports
Get started