Middleware Engineering - Kafka Architect

Scope:
Hands on Architect and Tech Lead with a broad range of experience in Data Engineering and Scalable Distributed Systems.
18 years of IT experience in design, development, testing, implementation, troubleshooting and production support for AWS, Big Data Engineering, Azure, Java/J2EE Applications.
9 years of experience in Big Data Engineering and Hadoop technologies such as Kafka, Spark, MapReduce, PIG, Hive, HBase, Sqoop, Shell Scripts, Linux/Unix, Perl, Scala, Falcon, Oozie, Ambari, Python, Spark SQL, Splunk, Tableau, Denodo, Starburst, Flink.
7 years of experience in AWS &
Azure cloud data platform design, development, and support.
Extensive knowledge and hands on experience of all AWS services like EC2, Lambda, EMR, Glue, VPC, Route53, S3, Datadog, CloudWatch, CloudTrail, Lakehouse, snowflake, SQS, SNS, Redshift, DynamoDB, NiFi, Docker, Step Functions, Airflow, PySpark, Databricks, Postgres, Sagemaker, AL/Client.
Extensive knowledge and hands on experience of all Azure services like ADF, Synapse, AppInsight, Databricks, Blob Storage, VM, Cosmos DB, data lake.
Extensive Experience in architecting critical Tier-0 applications with HA /DR.
Extensive Knowledge on AI/Client, Generative AI, Neural networks, Genetic Algorithms.
10 years of experience in full stack development in Java/J2EE applications (multi-tier web applications).
Experience in Automation testing for J2EE, Python and Hadoop projects.
10 years of Banking, Insurance, manufacturing, health care and telecom domains.
Good experience on governance and compliance (HIPAA, GDPR..Etc) and privacy controls.
Strong hands-on experience in RDBMS and Data Warehouse Databases like Redshift, Snowflake, Db2, SQL, Oracle, Hive and NoSQL, HBase, MongoDB.
Proficient in UNIX environment that includes command line, shell scripts and good understanding of network configurations and Server clustering.
Expertise in developing Use case diagrams, Class diagrams, Sequence diagrams, Visio, Architecture flows, Design patterns, MDM, Data mesh, IAD documents and user manuals.
Extensive experience in client interaction, user manual &
design document creations, trainings &
demos.
Experience in different roles- developer, data engineer, onsite coordinator, project leader, solution architect, Enterprise Architect with all types of project - development, maintenance, production support, testing.
Extensive experience in migrating On-premises to Cloud, cloud to cloud, between AWS different accounts.