Wednesday, August 28, 2019

Talend ETL - Move Azure SQL Data to NoSQL MongoDB

Here you will learn, How to Move Azure SQL Data to NoSQL MongoDB by using Talend Open Studio.
There are ways to transfer/sync data from Mongodb to SQL-server and Mongodb contains collections instead of table and the data is stored differently.

There is no way to directly move data from MongoDB to SQL Server. Because MongoDB data is non-relational, any such movement must involve defining a target relational data model in SQL Server, and then developing a transformation that can take the data in MongoDB and transform it into the target data model.

Most ETL tools such as Kettle or Talend can help you with this process, or if you're a glutton for punishment, you can just write gobs of code.

Keep in mind that if you need this transformation process to be online, or applied more than once, you may need to tweak it for any small changes in the structure or types of the data stored in MongoDB. As an example, if a developer adds a new field to a document inside a collection, your ETL process will need rethinking (possibly new data model, new transformation process, etc.).

Process of data flow - Move Azure SQL Database Data into NoSQL MongoDB 
Creating Azure SQL DB Connection - Connecting to an Azure SQL Database
Creating NoSQL Connection - Connecting to NoSQL MongoDB 
Pull data from Azure SQL Database table
Showing Data of from Azure SQL Database  
Load Data into NoSQL MongoDB
List of Talend components-
1. tDBInput -  Connecting with Azure SQL Database and pull data from Azure SQL Database Table
2. tLogRow – allows us to write data, that is flowing through our Job (rows), to the console
3. tMongoDBOutput - Connecting to NoSQL MongoDB and load data into collection

To Learn more, please visit our blog at - 
http://www.sql-datatools.com

To Learn more, please visit our YouTube channel at - 
http://www.youtube.com/c/Sql-datatools

To Learn more, please visit our Instagram account at -
https://www.instagram.com/asp.mukesh/

To Learn more, please visit our twitter account at -
https://twitter.com/macxima

1 comment:

  1. I believe there are many more pleasurable opportunities ahead for individuals that looked at your site. Needed to compose you a very little word to thank you yet again regarding the nice suggestions you’ve contributed here.
    Docker online training
    Docker certification training
    Docker online course
    Docker training course

    ReplyDelete