Searched defs:character_coverage (Results 1 – 9 of 9) sorted by relevance
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/ |
| D | build_sentence_piece_vocab_node.cc | 28 … float character_coverage, SentencePieceModel model_type, in BuildSentenceVocabNode()
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/text/ |
| D | sentence_piece_vocab.cc | 41 … float character_coverage, const SentencePieceModel &model_type, in BuildFromFile()
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/engine/datasetops/ |
| D | build_sentence_piece_vocab_op.cc | 25 … float character_coverage, SentencePieceModel model_type, in BuildSentencePieceVocabOp()
|
| /third_party/mindspore/mindspore-src/source/mindspore/python/mindspore/dataset/text/ |
| D | utils.py | 228 def from_dataset(cls, dataset, col_names, vocab_size, character_coverage, model_type, params): argument
269 def from_file(cls, file_path, vocab_size, character_coverage, model_type, params): argument
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/api/python/bindings/dataset/text/ |
| D | bindings.cc | 87 const std::unordered_map<std::string, std::string> ¶ms) { in __anonc5e3073e0802()
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/include/dataset/ |
| D | datasets.h | 282 const std::vector<std::string> &col_names, int32_t vocab_size, float character_coverage, in BuildSentencePieceVocab()
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/api/python/bindings/dataset/engine/ir/datasetops/ |
| D | bindings.cc | 145 … SentencePieceModel model_type, const std::unordered_map<std::string, std::string> ¶ms) { in __anon10ea60a00c02()
|
| /third_party/mindspore/mindspore-src/source/mindspore/python/mindspore/dataset/engine/ |
| D | datasets.py | 2160 … def build_sentencepiece_vocab(self, columns, vocab_size, character_coverage, model_type, params): argument
2241 … def _build_sentencepiece_vocab(self, columns, vocab_size, character_coverage, model_type, params): argument
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/api/ |
| D | datasets.cc | 612 const std::vector<std::vector<char>> &col_names, int32_t vocab_size, float character_coverage, in BuildSentencePieceVocabCharIF()
|