AnsweredAssumed Answered

importJSON tool for billions of JSON records

Question asked by crash_ on Sep 15, 2016
Latest reply on Sep 15, 2016 by crash_

I'm trying to use the mapr importJSON tool to import a ton of JSON records. The valid JSON schema for this would be:

[

{

   "_id":"1",

   "some_field":"some_value",

   "some_field2","some_value2"

  },

{

   "_id":"2",

   "some_field":"some_value",

   "some_field2","some_value2"

  }

]

 

However, the importJSON tool does not respect this format. I have ~5 billion records to write in this fashion, so creating files for each one of them and importing it that way seems very backwards.

 

command; mapr importJSON -src /tmp/lots_of_records.json -dst /mapr_tables/mapr_table_json

 

Any recommendations for getting this data onto a MapRDB JSON table?

Outcomes