Bulk 'import' of existing person/family data

Question

0

Bulk 'import' of existing person/family data

Nic De Vries posted 9 Years Ago

Hi, what is the best/easiest way to get an existing dataset (in my case in a MySQL database) into Rock as fast as possible so that we can work within rock from that point forward?

The REST API seems the most obvious way and I got some examples working on GET, but to POST/PUT seems not trivial as well as the consequence of impacting both the person and the family-group either needs to be 'addressed' by the API or I must write some code and know the relationship between the 'tables' to make sure I don't break anything.

Please advise.

0
- David Stevens replied 9 Years Ago
I would highly recommend a direct SQL-to-SQL approach if you're familiar enough with scripting to map the data. IMO it would be too slow & difficult to create relationships in Rock one model at a time (via the API).

We run our external site on MySQL and I've frequently had to connect between them; here's a great article that should get you started. How much data are you working with?
Edit Answer

I would highly recommend a direct SQL-to-SQL approach if you're familiar enough with scripting to map the data.  IMO it would be too slow & difficult to create relationships in Rock one model at a time (via the API). We run our external site on MySQL and I've frequently had to connect between them; here's <a href="http://www.ideaexcursion.com/2009/02/25/howto-setup-sql-server-linked-server-to-mysql/">a great article</a> that should get you started.  How much data are you working with?
I would highly recommend a direct SQL-to-SQL approach if you're familiar enough with scripting to map the data.  IMO it would be too slow & difficult to create relationships in Rock one model at a time (via the API). We run our external site on MySQL and I've frequently had to connect between them; here's <a href="http://www.ideaexcursion.com/2009/02/25/howto-setup-sql-server-linked-server-to-mysql/">a great article</a> that should get you started.  How much data are you working with?
I would highly recommend a direct SQL-to-SQL approach if you're familiar enough with scripting to map the data.  IMO it would be too slow & difficult to create relationships in Rock one model at a time (via the API). We run our external site on MySQL and I've frequently had to connect between them; here's <a href="http://www.ideaexcursion.com/2009/02/25/howto-setup-sql-server-linked-server-to-mysql/">a great article</a> that should get you started.  How much data are you working with?
Save Cancel
0
- Nic De Vries replied 9 Years Ago
Hi David, great, thank you for your response and thanks for the link as well!

We don't have much data, but it is just the principle of error-prone retyping or copy-pasting 60-odd families with their dependents while I already have it in MySQL.

Thanks.
Edit Answer

Hi David, great, thank you for your response and thanks for the link as well! We don't have much data, but it is just the principle of error-prone retyping or copy-pasting 60-odd families with their dependents while I already have it in MySQL. Thanks.
Hi David, great, thank you for your response and thanks for the link as well! We don't have much data, but it is just the principle of error-prone retyping or copy-pasting 60-odd families with their dependents while I already have it in MySQL. Thanks.
Hi David, great, thank you for your response and thanks for the link as well! We don't have much data, but it is just the principle of error-prone retyping or copy-pasting 60-odd families with their dependents while I already have it in MySQL. Thanks.
Save Cancel
0
- Nic De Vries replied 9 Years Ago
Great! I like it! I will certainly try out the Excavator!

Pardon my ignorance, but does "the" SampleData.xml refer to a specific tool or process or do you just mean using the xml format to do so via say Excavator?
Edit Answer

Great! I like it! I will certainly try out the Excavator! Pardon my ignorance, but does "the" SampleData.xml refer to a specific tool or process or do you just mean using the xml format to do so via say Excavator?
Great! I like it! I will certainly try out the Excavator! Pardon my ignorance, but does "the" SampleData.xml refer to a specific tool or process or do you just mean using the xml format to do so via say Excavator?
Great! I like it! I will certainly try out the Excavator! Pardon my ignorance, but does "the" SampleData.xml refer to a specific tool or process or do you just mean using the xml format to do so via say Excavator?
Save Cancel
David Stevens

9 years ago

No, there's a SampleData.xml that's included to import dummy data into a playground database: https://github.com/SparkDevNetwork/Rock/blob/master/Documentation/sampledata_1_3_0.xml

Depending how you export from MySQL you might find the XML easier to work with than a CSV. YMMV.
0
- Eyob Zeleke replied 6 Years Ago
@David Stevens, just a question on your response above ... "a direct SQL-to-SQL approach". Does rock allow me to dump data directly to SQL tables? Let's say Person table?
Edit Answer

@David Stevens, just a question on your response above ... "a direct SQL-to-SQL approach". Does rock allow me to dump data directly to SQL tables? Let's say Person table? 
@David Stevens, just a question on your response above ... "a direct SQL-to-SQL approach". Does rock allow me to dump data directly to SQL tables? Let's say Person table? 
@David Stevens, just a question on your response above ... "a direct SQL-to-SQL approach". Does rock allow me to dump data directly to SQL tables? Let's say Person table? 
Save Cancel
0
- Jeremy Hoff replied 1 Year Ago
Although this is an old thread, there is a new tool in v14 that allows the importing of data from other systems via CSV. Check it out here: https://community.rockrms.com/documentation/bookcontent/9#csvimport
I hope that helps,
Edit Answer

Although this is an old thread, there is a new tool in v14 that allows the importing of data from other systems via CSV. Check it out here: <a href="https://community.rockrms.com/documentation/bookcontent/9#csvimport" target="_blank">https://community.rockrms.com/documentation/bookcontent/9#csvimport</a>I hope that helps,
Although this is an old thread, there is a new tool in v14 that allows the importing of data from other systems via CSV. Check it out here: <a href="https://community.rockrms.com/documentation/bookcontent/9#csvimport" target="_blank">https://community.rockrms.com/documentation/bookcontent/9#csvimport</a>I hope that helps,
Although this is an old thread, there is a new tool in v14 that allows the importing of data from other systems via CSV. Check it out here: <a href="https://community.rockrms.com/documentation/bookcontent/9#csvimport" target="_blank">https://community.rockrms.com/documentation/bookcontent/9#csvimport</a>I hope that helps,
Save Cancel

David Stevens · Accepted Answer · 2015-05-12T05:56-07:00

0

David Stevens replied 9 Years Ago

WIth only 60 families I think it'd be easiest to export your data and import using the SampleData.XML or using the CSV import with Excavator.

Question

0

Bulk 'import' of existing person/family data

0

0

0

0

0

0