Pinnedsatabdi rayPaddle your own CanoeDeep down the heart I realise this phrase ‘Paddle your own canoe’ is so true. In this one life we have been given with pretty much…1 min read·Mar 2, 2021----
satabdi rayUsecase#4: Reverse-Explode Functionality using Spark-scalaRequirement is to reverse the Explode operation to convert the string into array values on Spark Dataframe.1 min read·Jan 3, 2022----
satabdi rayUsecase#3 on Spark-scalaUsecase: Source table is on PostgreSQL(any JDBC related Databases) having data as multidimensional array types. Requirement is to read the…2 min read·Sep 28, 2021--1--1
satabdi rayUsecase#2#Spark(Get a file of size in GB without downloading)Usecase: Get a file say csv of size 5GB–10GB and process it in Spark.1 min read·Jul 22, 2021----
satabdi rayHive connection (Remote Server) to Spark-scala (as sink/source) through JDBC (non Kerberos)If there is a requirement to connect to Hive installed on remote server to a Spark application(written in scala and running on separate AWS…2 min read·May 28, 2021----
satabdi raySFDC(Salesforce.com) Spark connector-(as sink/source)-scalaIf there is a usecase to add SFDC as a connector to a Spark application (written in scala), then here you can refer below code (Test.scala)…2 min read·May 28, 2021----
satabdi rayTeradata connector-Spark-Scala(sink/source)If there is a usecase to add Teradata as a connector to a Spark application (written in scala), then here you can refer below code…2 min read·May 28, 2021----
satabdi rayUsecase#1 on SparkScalaProblem Statement: There is a source DB2 and sink as MongoDb where you are reading data from DB2 and writing it to MongoDb. But while…1 min read·May 13, 2021----
satabdi rayGoogle Big Query connector-Spark-Scala(sink/source)If there is a usecase to add Big Query connector(using GCP) to a Spark application (written in scala), then here you can refer below code…2 min read·May 12, 2021----
satabdi raySnowflake Connector with Apache Spark(scala)- Source-Sink ConnectivityIf there is a requirement to add Cloud warehouse Snowflake connector to a Spark application written in scala, then here you can refer…2 min read·Apr 25, 2021----