A function to convert an OJAI Document to Spark's Row format.
A function to convert an OJAI Document to Spark's Row format.
OJAI Document to be converted to Spark's Row format.
Schema for the Row.
Factory function to create a new OJAIDocument from a json string.
Factory function to create a new OJAIDocument from a json string.
a json document.
Factory function to create a new OJAIDocument from org.ojai.Document.
Factory function to create a new OJAIDocument from org.ojai.Document.
Factory function to create a new OJAIDocument from org.ojai.Document.
org.ojai.Document
Factory function to create a new partitioner from splits provided as sequence.
Factory function to create a new partitioner from splits provided as sequence.
a sequence of splits Splits supported at this point are String and ByteBuffer. It is user's responsibility to supply the splits in ascending order.
Factory function to create a new partitioner using existing MapRDBTable.
Factory function to create a new partitioner using existing MapRDBTable.
existing tableName in MapRDB
A function to convert a Spark's ROW to OJAIDocument.
A function to convert a Spark's ROW to OJAIDocument.
Spark's Dataframe or Dataset Row.
Factory function to convert a ByteBuffer into a serializable binary value.
Factory function to convert a ByteBuffer into a serializable binary value.
ByteBuffer
MapRDBSpark is a static class which contains factory methods to create scala's ojai document and partitioner objects.
Factory functions to help create scala's ojai documents val doc = MapRDBSpark.newDocument(jsonString) val doc = MapRDBSpark.newDocument(document: org.ojai.Document) Here are the ways to access elements in OJAIDocument val partitioner = MapRDBSpark.newPartitioner(tableName) It creates a partitioiner using the splits specified in tableName. val partitioner = MapRDBSpark.newPartitioner(Seq("AA","CC")) It creates a partitioner using the splits provided in the sequence. Here three splits will be created (null, "AA") , ("AA","CC") and ("CC", null) Note that this call assumes that user supplies the splits in sorted order.