Home
last modified time | relevance | path

Searched full:batching (Results 1 – 25 of 405) sorted by relevance

12345678910>>...17

/external/sdk-platform-java/gax-java/gax/src/main/java/com/google/api/gax/batching/
DBatchingSettings.java30 package com.google.api.gax.batching;
32 import com.google.api.gax.batching.FlowController.LimitExceededBehavior;
39 * Represents the batching settings to use for an API method that is capable of batching.
41 * <p>By default the settings are configured to <b>not</b> use batching (i.e. the batch size
43 * scenarios. Users are expected to configure actual batching thresholds explicitly: the element
48 * <p>When batching is turned on for an API method, a call to that method will result in the request
81 * <p>For these values, individual requests that surpass the limit are rejected, and the batching
86 * <p>Batching also supports FlowControl. This can be used to prevent the batching implementation
88 * can occur if messages are created and added to batching faster than they can be processed. The
93 /** Get the element count threshold to use for batching. */
[all …]
DBatchingCallSettings.java30 package com.google.api.gax.batching;
43 * calls to an API method that supports batching. The batching settings are provided using the
46 * <p>Retry configuration will be applied on each batching RPC request.
77 /** Returns batching settings which contains multiple batch threshold levels. */
84 Preconditions.checkState(builder.batchingSettings != null, "batching settings cannot be null"); in BatchingCallSettings()
128 Preconditions.checkNotNull(batchingDescriptor, "batching descriptor cannot be null"); in Builder()
137 /** Sets the batching settings with various thresholds. */
DBatcherImpl.java30 package com.google.api.gax.batching;
39 import com.google.api.gax.batching.FlowController.FlowControlException;
40 import com.google.api.gax.batching.FlowController.FlowControlRuntimeException;
41 import com.google.api.gax.batching.FlowController.LimitExceededBehavior;
66 * Queues up the elements until {@link #flush()} is called; once batching is over, returned future
167 Preconditions.checkNotNull(batchingDescriptor, "batching descriptor cannot be null"); in BatcherImpl()
171 Preconditions.checkNotNull(batchingSettings, "batching setting cannot be null"); in BatcherImpl()
184 "If throttling and batching on element count are enabled, FlowController" in BatcherImpl()
191 "If throttling and batching on request bytes are enabled, FlowController" in BatcherImpl()
351 // Original stacktrace of a batching exception is not useful, so rethrow the error with in close()
[all …]
DBatchingFlowController.java30 package com.google.api.gax.batching;
32 import com.google.api.gax.batching.FlowController.FlowControlException;
36 /** Wraps a {@link FlowController} for use by batching. */
DBatcher.java30 package com.google.api.gax.batching;
37 * Represents a batching context where individual elements will be accumulated and flushed in a
73 * Sends accumulated elements asynchronously for batching.
DFlowControlSettings.java30 package com.google.api.gax.batching;
32 import com.google.api.gax.batching.FlowController.FlowControlException;
33 import com.google.api.gax.batching.FlowController.LimitExceededBehavior;
/external/tensorflow/tensorflow/python/data/experimental/kernel_tests/
Dmap_and_batch_test.py24 from tensorflow.python.data.experimental.ops import batching
66 batching.map_and_batch(
125 batching.map_and_batch(
145 batching.map_and_batch(lambda x: array_ops.reshape(x * x, [1]), 4)))
156 batching.map_and_batch(lambda x: x, batch_size=100))
182 batching.map_and_batch(
214 batching.map_and_batch(_sparse, 5))
233 dataset = dataset.apply(batching.map_and_batch(lambda x: x, 14))
250 dataset = dataset.apply(batching.map_and_batch(lambda x: x, batch_size))
270 1000).apply(batching.map_and_batch(_map_fn, batch_size=100))
[all …]
Ddense_to_sparse_batch_test.py19 from tensorflow.python.data.experimental.ops import batching
36 batching.dense_to_sparse_batch(4, [12]))
59 batching.dense_to_sparse_batch(4, [5, None]))
87 batching.dense_to_sparse_batch(4, [-2]))
94 batching.dense_to_sparse_batch(4, [12]))
115 batching.dense_to_sparse_batch(4, [12]))
/external/aws-sdk-java-v2/docs/design/core/batch-manager/
DDesign.md3 # Design Document (Automatic Request Batching)
10batching solution could not only be implemented in SQS but in any service that might benefit from …
66 Note: Focusing on automatic batching and manual flushing for the scope of the internship.
69 // 1. Automatic Batching
101 * Batch Manager class that implements batching features for a sync client.
163 * Batch Manager class that implements batching features for an async client.
229 * batching features.
254 ### **Why don’t we just implement batching features directly on the low level client?**
256 There are three options we discussed in implementing batching features:
258 1. Create batching features directly on the low level client
[all …]
DDecisionLog.md25 … we name the batching utility to make it more discoverable and easy to understand? We will name it…
48 1. (Old) What should we name the batching utility to make it more discoverable and easy to understa…
58 1. Should we implement batching methods directly on the client or in a separate utility as proposed…
73 3. (New) What should we name the batching utility to make it more discoverable and easy to understa…
/external/sdk-platform-java/gax-java/gax/src/main/java/com/google/api/gax/rpc/
DBatcherFactory.java33 import com.google.api.gax.batching.BatchingFlowController;
34 import com.google.api.gax.batching.BatchingSettings;
35 import com.google.api.gax.batching.BatchingThreshold;
36 import com.google.api.gax.batching.ElementCounter;
37 import com.google.api.gax.batching.FlowController;
38 import com.google.api.gax.batching.NumericThreshold;
39 import com.google.api.gax.batching.PartitionKey;
40 import com.google.api.gax.batching.ThresholdBatcher;
DBatchingCallable.java34 import com.google.api.gax.batching.FlowController.FlowControlException;
35 import com.google.api.gax.batching.FlowController.FlowControlRuntimeException;
36 import com.google.api.gax.batching.PartitionKey;
37 import com.google.api.gax.batching.ThresholdBatcher;
43 * the BatchingDescriptor. An example of a batching partition would be a pubsub topic.
DBatchingDescriptor.java32 import com.google.api.gax.batching.PartitionKey;
33 import com.google.api.gax.batching.RequestBuilder;
38 * batching.
DBatch.java33 import com.google.api.gax.batching.BatchMerger;
34 import com.google.api.gax.batching.ElementCounter;
35 import com.google.api.gax.batching.RequestBuilder;
DBatchingCallSettings.java33 import com.google.api.gax.batching.BatchingSettings;
34 import com.google.api.gax.batching.FlowController;
42 * batching. The settings are provided using an instance of {@link BatchingSettings}.
/external/sdk-platform-java/gax-java/gax/src/test/java/com/google/api/gax/rpc/
DBatcherFactoryTest.java34 import com.google.api.gax.batching.BatchingSettings;
35 import com.google.api.gax.batching.FlowControlSettings;
36 import com.google.api.gax.batching.FlowController;
37 import com.google.api.gax.batching.FlowController.LimitExceededBehavior;
38 import com.google.api.gax.batching.PartitionKey;
39 import com.google.api.gax.batching.ThresholdBatcher;
DBatchingCallableTest.java33 import com.google.api.gax.batching.BatchingSettings;
34 import com.google.api.gax.batching.FlowControlSettings;
35 import com.google.api.gax.batching.FlowController;
36 import com.google.api.gax.batching.FlowController.LimitExceededBehavior;
93 // Assume it won't take 10 seconds (the batching delay threshold) to check the first future in testBatchedCall()
DBatchingTest.java36 import com.google.api.gax.batching.BatchingSettings;
37 import com.google.api.gax.batching.FlowControlSettings;
38 import com.google.api.gax.batching.FlowController.LimitExceededBehavior;
39 import com.google.api.gax.batching.TrackedFlowController;
82 public void batching() throws Exception { in batching() method in BatchingTest
226 Assert.fail("Expected exception from batching call"); in batchingException()
232 Assert.fail("Expected exception from batching call"); in batchingException()
/external/tensorflow/tensorflow/core/kernels/batching_util/
Dbatch_resource_base.cc48 {"/tensorflow/serving/batching/padding_size", in RecordPaddingSize()
61 {"/tensorflow/serving/batching/padding_size_v2", in RecordPaddingSizeV2()
76 {"/tensorflow/serving/batching/input_batch_size", in RecordInputBatchSize()
88 {"/tensorflow/serving/batching/input_batch_size_v2", in RecordInputBatchSizeV2()
102 {"/tensorflow/serving/batching/batch_size", in RecordBatchSize()
113 {"/tensorflow/serving/batching/processed_batch_size", in RecordProcessedBatchSize()
126 "/tensorflow/serving/batching/processed_batch_size_v2", in RecordProcessedBatchSizeV2()
138 {"/tensorflow/serving/batching/batch_delay_us", in RecordBatchDelayUs()
139 "Tracks the batching delay (in microseconds) for inputs by model_name " in RecordBatchDelayUs()
151 {"/tensorflow/serving/batching/batch_delay_us_v2", in RecordBatchDelayUsV2()
[all …]
/external/sdk-platform-java/gax-java/
DREADME.md12 files can use services such as paged list iteration, request batching, and
131 - **Batching** - Batching features are not yet considered stable.
147 retries, pagination, batching, utilities and core logic.
149 - `com.google.api.gax.batching` - Contains general-purpose batching logic.
/external/sdk-platform-java/gax-java/gax/src/test/java/com/google/api/gax/rpc/testing/
DFakeBatchableApi.java35 import com.google.api.gax.batching.BatchEntry;
36 import com.google.api.gax.batching.BatchingRequestBuilder;
37 import com.google.api.gax.batching.PartitionKey;
38 import com.google.api.gax.batching.RequestBuilder;
185 implements com.google.api.gax.batching.BatchingDescriptor<
/external/tensorflow/tensorflow/python/data/experimental/
D__init__.py97 from tensorflow.python.data.experimental.ops.batching import dense_to_ragged_batch
98 from tensorflow.python.data.experimental.ops.batching import dense_to_sparse_batch
99 from tensorflow.python.data.experimental.ops.batching import map_and_batch
100 from tensorflow.python.data.experimental.ops.batching import map_and_batch_with_legacy_function
101 from tensorflow.python.data.experimental.ops.batching import unbatch
/external/sdk-platform-java/gax-java/gax/src/test/java/com/google/api/gax/batching/
DFlowControlEventStatsTest.java30 package com.google.api.gax.batching;
37 import com.google.api.gax.batching.FlowControlEventStats.FlowControlEvent;
38 import com.google.api.gax.batching.FlowController.MaxOutstandingRequestBytesReachedException;
/external/grpc-grpc/doc/cpp/
Dperf_notes.md7 threads, but currently cannot automatically infer batching in a single stream.
10 possible to enable write batching by passing a WriteOptions argument to Write
/external/cronet/testing/unexpected_passes_common/
Dargument_parsing.py86 parser.add_argument('--disable-batching',
90 help=('Disables the use of batching when running '
91 'queries. Batching allows for more queries to be '

12345678910>>...17