package avro
- Alphabetic
- Public
- Protected
Type Members
- class AvroConfluentClient extends ConfluentClient[AvroSchema]
- case class CatalystDataToConfluentAvro(child: Expression, subject: String, confluentHelper: ConfluentClient[AvroSchema], updateAllowed: Boolean, mutualReadCheck: Boolean = false) extends UnaryExpression with Logging with Product with Serializable
- class ConfluentAvroConnector extends ConfluentConnector
Provides Spark SQL functions from/to_confluent_avro for decoding/encoding confluent avro messages.
- case class ConfluentAvroDataToCatalyst(child: Expression, subject: String, confluentHelper: ConfluentClient[AvroSchema]) extends UnaryExpression with ExpectsInputTypes with Product with Serializable
- class MyAvroSerializer extends Logging
A serializer to serialize data in catalyst format to data in avro format.
A serializer to serialize data in catalyst format to data in avro format.
copied from org.apache.spark.sql.avro.* Changes: - backport support for nullable vs non-nullable types in resolveNullableType - enhance resolveNullableType to support converting NullType to Null-Union - enhance resolveNullableType to support converting not nullable type to Null-Union - improve exception messages by adding field name
Value Members
- object AvroSchemaConverter
This object contains method that are used to convert sparkSQL schemas to avro schemas and vice versa.
This object contains method that are used to convert sparkSQL schemas to avro schemas and vice versa.
Copied from org.apache.spark.sql.avro.SchemaConverters
Changes: - Backport support for nullType from Spark 3.0 - Fix nullable fields optional: null type must be first in union and default=null is needed
- object ConfluentAvroConnector extends Serializable