Prasuna Reddy Salepela
Atlanta
Summary
Dynamic Senior Data Engineer with proven expertise at LTIMindtree, specializing in ETL development and big data processing. Achieved a 50% improvement in processing speed through optimized Spark jobs. Adept in Python and SQL, with strong collaboration skills, mentoring junior engineers, and driving successful data architecture initiatives.
Overview
15
15
years of professional experience
Work History
Senior Data Engineer
LTIMindtree
02.2023 - Current
- Company Overview: Client: Bank Of America
- Designed and implemented ETL processes using python programming language where data is handled using pandas and pyspark
- SQL to transform and load large datasets into data warehouses, improving data accessibility and analytics efficiency
- Migrated python ETL framework from pandas to pyspark and efficiently processed big data using on premises spark infrastructure.
- Performed data profiling based on the load and type of data, and achieved 50% more improvement in processing speed.
- Reduced data processing time by 40% by optimizing spark jobs and implementing caching using dataframes.
- Achieved 10x faster execution of batch jobs by tuning spark configurations(eg: partitions, memory, parallelism)
- Developed custom UDFs in pyspark to extend the functionality of Spark jobs.
- Developed and worked with REST APIs to post and get the data from external systems.
- Designed data pipelines to support large-scale data processing using Apache Airflow.
- Collaborated with cross-functional teams to gather data requirements.
- Mentored junior engineers on best practices in data architecture.
- Integrated third-party APIs for seamless data ingestion into systems.
- Profiled the data and performed capacity planning to process huge volume of data on spark clusters
- Tasks are scheduled using orchestration layer Apache Airflow
- Ensured data quality and integrity through rigorous testing and validation processes.
- Performed RDD map-partitions to make batch calls to external API and gained an improvement of 50% of overall processing.
- Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
- Experienced with full software development life-cycle, architecting scalable platforms, object oriented programming, database design and agile methodologies.
- Experienced in LAMP (Linux, Apache, MySQL and Python), WAMP (Windows, Apache, MySQL, Python) architecture.
- Excellent experience with Python development under Linux OS (Debian, Ubuntu, SUSE Linux, RedHat Linux, Fedora).
- Experience with several Python packages like Numpy, Matplotlib, Scipy, PyQt, wxpython and PyTables.
- Experience in developing web applications by following Model-View-Controller (MVC) architecture using server-side application Django.
- Experience in developing web services (WSDL, SOAP and REST) and consuming web services with python programming language.
- Experienced in working with various Python Integrated Development Environments like NetBeans, PyCharm, PyScripter, PyDev, Eclipse and Sublime Text.
- Strong exposure in writing simple and complex SQL queries and creating PL/SQL Functions, Stored Procedures.
- • Good Knowledge on Amazon Web Services (AWS) Cloud services such as EC2, EBS, S3, VPC, Cloud Watch, and Elastic Load Balancer.
- Expert on OOPS, Multi-threading, Exception-Handling & Collections in python.
- Experience using version control system such as GIT.
- Experience in relational databases like Oracle MS SQL server, developing PL/SQL packages, Stored Procedures, Functions, Views, Indexes, Triggers, XML join, user defined data types and other complex queries.
- Having experienced in Agile Methodologies, Scrum stories and sprints experience in a Python based environment, along with data analytics, data wrangling and Excel data extracts.
- Ensured quality and deadlines using Jenkins, Pylint, Git Hub, SVN and JIRA
- Experience with working on multiple environments like development, testing, production. Excellent analytical and problem-solving skills and ability to work on own besides being valuable and contributing team player.
- Excellent communication and interpersonal skills with ability to interact with individuals at all levels and can work as a part of team as well as independently.
- Forward-thinking Senior Specialist equipped with advanced operational and technical knowledge of pyspark. Proven team leader and problem-solver competent in navigating complex situations.
Data Engineer
Cognizant
02.2016 - 12.2016
- Company Overview: Client: John Hancock
- Participated in entire lifecycle of the projects including Design, Development, and Deployment, Testing and Implementation and support
- Developed web applications in Django Framework's model view control (MVC) architecture and manipulated databases by using Django database API along with MySQL
- Created a Python, Django web-based application using Python scripting for data processing and MySQL for database, HTML5, CSS and JQuery for data visualization
- Using Amazon EC2 command line interface along with Bash/Python to automate work
- Worked with View Sets in Django-REST framework for providing web services and consumed web services performing CRUD operations
- Designed and Developed User Interface using front-end technologies like HTML5, CSS3, JavaScript, Bootstrap and JSON
- Used Test driven approach for developing the application and implemented the unit tests using Python Unit test framework
SENIOR PYTHON DEVELOPER
Infosys Ltd.
06.2013 - 02.2016
- Company Overview: Client: Walmart
- Exposed to various phases of Software Development Life Cycle using Agile - Scrum Software development methodology
- Developed views and templates with Python and Django's view controller and templating language to create a user-friendly website interface
- Developed Restful API's using Django and SQLAlchemy data models as well as ensured code quality by writing unit tests using PyTest
- Worked on JavaScript MVC Framework like Angular.js
- Created entire application using Python, Django, MySQL, and Linux
- Created Data tables utilizing PyQt to display patient and policy information and add, delete, update patient records
- Involved in web designing using HTML 5, XHTML, CSS 3, JQuery, JavaScript extensively used Table less Design in CSS for positioning
- Developed the required XML Schema documents and implemented the framework to parse
- Created a Git repository and added the project to GitHub
- Utilize PyUnit, the Python unit test framework, for all Python applications
- Designed and developed the UI of the website using HTML, XHTML, AJAX, CSS, and JavaScript
Python Developer
Infosys Ltd.
04.2012 - 06.2013
- Company Overview: Client: Mondelez
- Requirement Analysis and Estimation of project timelines.
- Created Business Logic using Python to create Planning and Tracking functions.
- Developed Python batch processors to consume and produce various feeds.
- Developed internal auxiliary web apps using Django framework with CSS / HTML framework.
- Involved in designing, constructing and documenting various object oriented applications using UML, Rational Rose.
- Built database Model, Views and API's using Python for interactive web based solutions.
- Used Python scripts to update the content in database and manipulate files.
- Designed and developed the presentation layer/client end using HTML, XML, DHTML and JSP.
- Wrote SQL Queries, Store Procedures, Triggers and functions in MySQL Databases.
- Coordinate with SMEs, other architects, and senior technical staff to identify client’s needs, document assumptions, and build-out new requirements and move code through user acceptance testing.
- Implemented Test Driven Development (TDD) strategy for the project.
- Developed and executed User Acceptance Testing portion of test plan.
Junior Python Developer
Infosys Ltd.
10.2010 - 04.2012
- Company Overview: Client: Sears
- Involved in the Design, development, test, deploy and maintenance of the website.
- Used Django framework for application development.
- Used Django configuration to manage URLs and application parameters.
- Worked in Test driven development with Behave in Python.
- Used HTML5/CSS3, XML and JavaScript for UI development.
- Used Angular.js as a mechanism to manage and organize the HTML page layout.
- Worked with JQuery for all client-side JavaScript manipulation.
- Implemented database access using Django ORM.
- Performed data extraction and manipulation over large relational datasets using SQL, Python, and other analytical tools.
- Used Python libraries and SQL queries/subqueries to create several datasets which produced statistics, tables, figures, charts and graphs.
- Wrote validation scripts in SQL to validate data loading.
- Followed Agile Methodology and SCRUM Process.
- Performed Unit and system testing.
- Trained users and provided production support.
Education
Master of Science - Computer Science
Kennesaw State University
Atlanta, GA12.2022
Bachelor of Science - Information Technology
Jawaharlal Nehru Technological University
IndiaSkills
- ETL development
- Pyspark
- Python
- Apache Airflow
- SQL
- GIT
- REST
- Apache spark
- Ansible
- Jenkins
- Big data processing
- Agile methodologies
- API development
- Relational databases
Timeline
Senior Data Engineer
LTIMindtree
02.2023 - Current
Data Engineer
Cognizant
02.2016 - 12.2016
SENIOR PYTHON DEVELOPER
Infosys Ltd.
06.2013 - 02.2016
Python Developer
Infosys Ltd.
04.2012 - 06.2013
Junior Python Developer
Infosys Ltd.
10.2010 - 04.2012
Master of Science - Computer Science
Kennesaw State University
Bachelor of Science - Information Technology
Jawaharlal Nehru Technological University