Types for BigQuery Storage API Client#

class google.cloud.bigquery_storage_v1beta1.types.AvroRows#

Avro rows.

serialized_binary_rows#

Binary serialized rows in a block.

row_count#

The count of rows in the returning block.

row_count

Field google.cloud.bigquery.storage.v1beta1.AvroRows.row_count

serialized_binary_rows

Field google.cloud.bigquery.storage.v1beta1.AvroRows.serialized_binary_rows

class google.cloud.bigquery_storage_v1beta1.types.AvroSchema#

Avro schema.

schema#

Json serialized schema, as described at https://avro.apache.org/docs/1.8.1/spec.html

schema

Field google.cloud.bigquery.storage.v1beta1.AvroSchema.schema

class google.cloud.bigquery_storage_v1beta1.types.BatchCreateReadSessionStreamsRequest#

Information needed to request additional streams for an established read session.

session#

Required. Must be a non-expired session obtained from a call to CreateReadSession. Only the name field needs to be set.

requested_streams#

Required. Number of new streams requested. Must be positive. Number of added streams may be less than this, see CreateReadSessionRequest for more information.

requested_streams

Field google.cloud.bigquery.storage.v1beta1.BatchCreateReadSessionStreamsRequest.requested_streams

session

Field google.cloud.bigquery.storage.v1beta1.BatchCreateReadSessionStreamsRequest.session

class google.cloud.bigquery_storage_v1beta1.types.BatchCreateReadSessionStreamsResponse#

The response from BatchCreateReadSessionStreams returns the stream identifiers for the newly created streams.

streams#

Newly added streams.

streams

Field google.cloud.bigquery.storage.v1beta1.BatchCreateReadSessionStreamsResponse.streams

class google.cloud.bigquery_storage_v1beta1.types.CreateReadSessionRequest#

Creates a new read session, which may include additional options such as requested parallelism, projection filters and constraints.

table_reference#

Required. Reference to the table to read.

parent#

Required. String of the form projects/{project_id} indicating the project this ReadSession is associated with. This is the project that will be billed for usage.

table_modifiers#

Optional. Any modifiers to the Table (e.g. snapshot timestamp).

requested_streams#

Optional. Initial number of streams. If unset or 0, we will provide a value of streams so as to produce reasonable throughput. Must be non-negative. The number of streams may be lower than the requested number, depending on the amount parallelism that is reasonable for the table and the maximum amount of parallelism allowed by the system. Streams must be read starting from offset 0.

read_options#

Optional. Read options for this session (e.g. column selection, filters).

format#

Data output format. Currently default to Avro.

format

Field google.cloud.bigquery.storage.v1beta1.CreateReadSessionRequest.format

parent

Field google.cloud.bigquery.storage.v1beta1.CreateReadSessionRequest.parent

read_options

Field google.cloud.bigquery.storage.v1beta1.CreateReadSessionRequest.read_options

requested_streams

Field google.cloud.bigquery.storage.v1beta1.CreateReadSessionRequest.requested_streams

table_modifiers

Field google.cloud.bigquery.storage.v1beta1.CreateReadSessionRequest.table_modifiers

table_reference

Field google.cloud.bigquery.storage.v1beta1.CreateReadSessionRequest.table_reference

class google.cloud.bigquery_storage_v1beta1.types.Empty#
class google.cloud.bigquery_storage_v1beta1.types.FinalizeStreamRequest#

Request information for invoking FinalizeStream.

stream#

Stream to finalize.

stream

Field google.cloud.bigquery.storage.v1beta1.FinalizeStreamRequest.stream

class google.cloud.bigquery_storage_v1beta1.types.ReadRowsRequest#

Requesting row data via ReadRows must provide Stream position information.

read_position#

Required. Identifier of the position in the stream to start reading from. The offset requested must be less than the last row read from ReadRows. Requesting a larger offset is undefined.

read_position

Field google.cloud.bigquery.storage.v1beta1.ReadRowsRequest.read_position

class google.cloud.bigquery_storage_v1beta1.types.ReadRowsResponse#

Response from calling ReadRows may include row data, progress and throttling information.

rows#

Row data is returned in format specified during session creation.

avro_rows#

Serialized row data in AVRO format.

status#

Estimated stream statistics.

throttle_status#

Throttling status. If unset, the latest response still describes the current throttling status.

avro_rows

Field google.cloud.bigquery.storage.v1beta1.ReadRowsResponse.avro_rows

status

Field google.cloud.bigquery.storage.v1beta1.ReadRowsResponse.status

throttle_status

Field google.cloud.bigquery.storage.v1beta1.ReadRowsResponse.throttle_status

class google.cloud.bigquery_storage_v1beta1.types.ReadSession#

Information returned from a CreateReadSession request.

name#

Unique identifier for the session, in the form projects/{pro ject_id}/locations/{location}/sessions/{session_id}.

expire_time#

Time at which the session becomes invalid. After this time, subsequent requests to read this Session will return errors.

schema#

The schema for the read. If read_options.selected_fields is set, the schema may be different from the table schema as it will only contain the selected fields.

avro_schema#

Avro schema.

streams#

Streams associated with this session.

table_reference#

Table that this ReadSession is reading from.

table_modifiers#

Any modifiers which are applied when reading from the specified table.

avro_schema

Field google.cloud.bigquery.storage.v1beta1.ReadSession.avro_schema

expire_time

Field google.cloud.bigquery.storage.v1beta1.ReadSession.expire_time

name

Field google.cloud.bigquery.storage.v1beta1.ReadSession.name

streams

Field google.cloud.bigquery.storage.v1beta1.ReadSession.streams

table_modifiers

Field google.cloud.bigquery.storage.v1beta1.ReadSession.table_modifiers

table_reference

Field google.cloud.bigquery.storage.v1beta1.ReadSession.table_reference

class google.cloud.bigquery_storage_v1beta1.types.SplitReadStreamRequest#

Request information for SplitReadStream.

original_stream#

Stream to split.

original_stream

Field google.cloud.bigquery.storage.v1beta1.SplitReadStreamRequest.original_stream

class google.cloud.bigquery_storage_v1beta1.types.SplitReadStreamResponse#

Response from SplitReadStream.

primary_stream#

Primary stream. Will contain the beginning portion of |original_stream|.

remainder_stream#

Remainder stream. Will contain the tail of |original_stream|.

primary_stream

Field google.cloud.bigquery.storage.v1beta1.SplitReadStreamResponse.primary_stream

remainder_stream

Field google.cloud.bigquery.storage.v1beta1.SplitReadStreamResponse.remainder_stream

class google.cloud.bigquery_storage_v1beta1.types.Stream#

Information about a single data stream within a read session.

name#

Name of the stream, in the form projects/{project_id}/locati ons/{location}/streams/{stream_id}.

row_count#

Rows in the stream.

name

Field google.cloud.bigquery.storage.v1beta1.Stream.name

row_count

Field google.cloud.bigquery.storage.v1beta1.Stream.row_count

class google.cloud.bigquery_storage_v1beta1.types.StreamPosition#

Expresses a point within a given stream using an offset position.

stream#

Identifier for a given Stream.

offset#

Position in the stream.

offset

Field google.cloud.bigquery.storage.v1beta1.StreamPosition.offset

stream

Field google.cloud.bigquery.storage.v1beta1.StreamPosition.stream

class google.cloud.bigquery_storage_v1beta1.types.StreamStatus#

Progress information for a given Stream.

estimated_row_count#

Number of estimated rows in the current stream. May change over time as different readers in the stream progress at rates which are relatively fast or slow.

estimated_row_count

Field google.cloud.bigquery.storage.v1beta1.StreamStatus.estimated_row_count

class google.cloud.bigquery_storage_v1beta1.types.TableModifiers#

All fields in this message optional.

snapshot_time#

The snapshot time of the table. If not set, interpreted as now.

snapshot_time

Field google.cloud.bigquery.storage.v1beta1.TableModifiers.snapshot_time

class google.cloud.bigquery_storage_v1beta1.types.TableReadOptions#

Options dictating how we read a table.

selected_fields#

Optional. Names of the fields in the table that should be read. If empty, all fields will be read. If the specified field is a nested field, all the sub-fields in the field will be selected. The output field order is unrelated to the order of fields in selected_fields.

row_restriction#

Optional. SQL text filtering statement, similar to a WHERE clause in a query. Currently, only a single predicate that is a comparison between a column and a constant value is supported. Aggregates are not supported. Examples: “int_field > 5” “date_field = CAST(‘2014-9-27’ as DATE)” “nullable_field is not NULL” “st_equals(geo_field, st_geofromtext(“POINT(2, 2)”))” “numeric_field BETWEEN 1.0 AND 5.0”

row_restriction

Field google.cloud.bigquery.storage.v1beta1.TableReadOptions.row_restriction

selected_fields

Field google.cloud.bigquery.storage.v1beta1.TableReadOptions.selected_fields

class google.cloud.bigquery_storage_v1beta1.types.TableReference#

Table reference that includes just the 3 strings needed to identify a table.

project_id#

The assigned project ID of the project.

dataset_id#

The ID of the dataset in the above project.

table_id#

The ID of the table in the above dataset.

dataset_id

Field google.cloud.bigquery.storage.v1beta1.TableReference.dataset_id

project_id

Field google.cloud.bigquery.storage.v1beta1.TableReference.project_id

table_id

Field google.cloud.bigquery.storage.v1beta1.TableReference.table_id

class google.cloud.bigquery_storage_v1beta1.types.ThrottleStatus#

Information on if the current connection is being throttled.

throttle_percent#

How much this connection is being throttled. 0 is no throttling, 100 is completely throttled.

throttle_percent

Field google.cloud.bigquery.storage.v1beta1.ThrottleStatus.throttle_percent

class google.cloud.bigquery_storage_v1beta1.types.Timestamp#
nanos#

Field google.protobuf.Timestamp.nanos

seconds#

Field google.protobuf.Timestamp.seconds