Datasets:

yresearch
/

owt-gpt2

input_ids listlengths 1.02k 1.02k
[ 50256, 13924, 12, 559, 12, 35784, 11, 25051, 357, 18474, 8, 1377, 45591, 4970, 11, 1319, 44556, 287, 2356, 290, 44787, 379, 1204, 11, 7342, 7519, 290, 20669, 2513, 1497, 422, 257, 2214, 4436, 3217, 1755, 706, 257, 21402, 3315, 1074, 2...
[ 50256, 3236, 3146, 286, 6686, 13, 383, 15760, 11, 900, 510, 739, 1811, 29804, 11, 373, 257, 11858, 437, 284, 262, 1178, 508, 547, 9670, 284, 423, 587, 3181, 612, 13, 198, 198, 9781, 1202, 5407, 19090, 13, 5215, 13, 9223, 741, 8835, ...
[ 50256, 447, 247, 82, 19975, 286, 1301, 447, 247, 82, 2450, 6116, 14846, 588, 257, 12714, 286, 7159, 284, 1282, 13, 198, 198, 447, 250, 2215, 356, 3285, 257, 4540, 329, 1893, 869, 329, 262, 38185, 510, 286, 1105, 1510, 7971, 11, 1947...
[ 50256, 9591, 11, 18655, 76, 31920, 11, 257, 2605, 12525, 13, 31920, 447, 247, 82, 7546, 10109, 423, 5710, 284, 477, 12, 2435, 34119, 10371, 36512, 625, 257, 1644, 4395, 290, 1524, 3542, 654, 11, 290, 465, 11533, 351, 5510, 1605, 4446,...
[ 50256, 11, 355, 22309, 7212, 4424, 75, 2630, 11, 366, 15344, 82, 503, 339, 4001, 339, 1549, 307, 8680, 284, 465, 898, 3809, 13, 2750, 262, 886, 286, 262, 30681, 1785, 11, 1770, 13, 2486, 550, 9635, 329, 15136, 2431, 1377, 5193, 2431...
[ 50256, 21639, 3006, 11, 3296, 49206, 34767, 618, 511, 4004, 21580, 4120, 287, 257, 2647, 2008, 13, 1736, 463, 1843, 3337, 2492, 447, 247, 83, 772, 257, 3860, 1336, 1865, 13, 198, 198, 1722, 262, 14359, 6364, 21050, 284, 5339, 11, 262,...
[ 50256, 1266, 287, 6983, 1461, 13, 8989, 11, 355, 262, 10010, 8391, 11, 262, 845, 1103, 2126, 326, 1123, 2888, 561, 17777, 2672, 762, 6820, 2376, 12657, 5699, 13, 887, 340, 1422, 447, 247, 83, 2300, 851, 611, 428, 373, 26746, 33, 155...
[ 50256, 2695, 373, 407, 36102, 11, 25304, 393, 40557, 11, 339, 531, 13, 564, 250, 5246, 13, 41414, 559, 318, 1290, 1165, 12661, 284, 1975, 428, 284, 307, 523, 13, 447, 251, 383, 42464, 635, 7763, 257, 6454, 38258, 8408, 286, 257, 376...
[ 50256, 11, 340, 447, 247, 82, 534, 9040, 13, 8734, 262, 5129, 2427, 286, 12225, 290, 407, 1804, 1997, 670, 1327, 290, 2648, 262, 5129, 11, 447, 251, 1139, 40766, 13109, 13, 50256, 8888, 11, 20182, 3414, 2458, 287, 12353, 447, 247, 3...
[ 50256, 11, 262, 1923, 1028, 2258, 4969, 1625, 355, 645, 5975, 13, 7148, 2269, 364, 11, 257, 31335, 5887, 329, 955, 24313, 351, 1998, 287, 262, 2351, 4765, 7732, 11, 1297, 7320, 22167, 326, 10075, 4560, 588, 262, 530, 1028, 2258, 4969,...
[ 50256, 547, 788, 1021, 12, 16760, 351, 6588, 13608, 13, 26386, 584, 3354, 547, 3562, 287, 262, 37292, 1430, 42482, 11, 878, 852, 513, 35, 10398, 13, 198, 198, 464, 3463, 2994, 1430, 318, 3257, 25, 1318, 447, 247, 82, 645, 5852, 13, ...
[ 50256, 262, 1266, 326, 339, 1718, 883, 24205, 1039, 866, 13, 2293, 477, 11, 7288, 4206, 612, 389, 645, 1263, 29206, 418, 287, 262, 1578, 1829, 3845, 13, 50256, 8086, 1463, 0, 770, 1705, 373, 3199, 319, 262, 1468, 2196, 286, 262, 305...
[ 50256, 12235, 8227, 1839, 447, 247, 83, 1745, 262, 1637, 851, 340, 447, 247, 297, 655, 1560, 606, 703, 881, 1637, 484, 714, 423, 7366, 2014, 198, 198, 464, 3061, 11, 339, 2087, 11, 318, 284, 5160, 2063, 257, 2997, 5054, 287, 6426, ...
[ 50256, 286, 11, 4700, 888, 11, 25866, 13001, 11, 393, 584, 1029, 32655, 290, 337, 9409, 368, 11025, 669, 13, 447, 251, 1215, 7820, 198, 198, 464, 6136, 2276, 286, 262, 1578, 1829, 318, 257, 3026, 3818, 13, 1002, 339, 468, 19837, 739...
[ 50256, 1099, 5394, 3818, 286, 674, 1499, 290, 1276, 10931, 13, 1318, 1276, 307, 281, 4795, 11, 20953, 11, 2354, 5810, 284, 9161, 262, 1301, 1964, 11, 2614, 290, 3176, 8787, 284, 262, 13234, 13, 447, 251, 198, 198, 32998, 4390, 3554, ...
[ 50256, 3088, 284, 1037, 3415, 3759, 1301, 1592, 262, 471, 13, 50, 13, 12112, 416, 15656, 4390, 3615, 9597, 13, 9070, 468, 6699, 262, 7636, 13, 198, 198, 33528, 389, 1865, 284, 2610, 866, 370, 1236, 330, 563, 447, 247, 82, 4301, 7035...
[ 50256, 340, 351, 262, 5290, 2657, 287, 534, 1021, 1635, 5064, 9, 340, 19575, 534, 1021, 357, 47531, 7157, 14, 38618, 347, 32620, 737, 3811, 1028, 2580, 803, 9135, 7691, 284, 1592, 2872, 711, 290, 8996, 534, 8198, 284, 584, 2137, 33140...
[ 50256, 2706, 4414, 422, 50233, 355, 14621, 364, 11, 257, 4876, 262, 50233, 1690, 1011, 319, 22295, 13, 887, 508, 318, 1804, 262, 1266, 1693, 355, 7078, 805, 30, 25913, 3496, 15802, 355, 257, 1296, 286, 17819, 11, 262, 1708, 318, 281, ...
[ 50256, 2688, 3834, 32679, 8366, 3337, 287, 9121, 3250, 11, 810, 465, 4006, 373, 44945, 11, 1644, 531, 13, 198, 198, 15137, 661, 547, 10657, 1141, 257, 734, 12, 9769, 48831, 286, 29276, 3502, 1755, 13, 198, 198, 8585, 838, 279, 13, 7...
[ 50256, 11, 4697, 6805, 11, 1390, 262, 6591, 26515, 11, 481, 761, 284, 307, 6928, 416, 262, 886, 286, 262, 12131, 82, 11, 531, 3851, 2047, 29074, 641, 11, 10636, 3437, 286, 8884, 447, 247, 82, 33805, 7458, 13, 3412, 611, 262, 33805, ...
[ 50256, 12, 10365, 3507, 2056, 11, 1957, 7941, 290, 16435, 423, 4888, 5861, 290, 5205, 4478, 262, 976, 15052, 9694, 2615, 11, 290, 1588, 1271, 286, 606, 24456, 262, 15135, 329, 14523, 262, 26665, 25, 198, 198, 2348, 12, 24597, 9189, 30...
[ 50256, 2102, 11, 355, 4186, 10382, 6496, 287, 428, 1810, 1148, 347, 3255, 3704, 11, 743, 880, 423, 262, 5339, 284, 8076, 379, 1755, 13, 198, 198, 1858, 318, 3058, 645, 5874, 2370, 284, 6216, 262, 779, 286, 257, 5711, 12, 2673, 5194,...
[ 50256, 262, 6670, 286, 523, 881, 5076, 287, 1909, 447, 247, 82, 3592, 30, 198, 198, 6, 28795, 12, 17067, 5465, 6, 198, 198, 32, 989, 422, 262, 2059, 286, 18899, 11, 705, 13300, 356, 389, 16563, 25, 383, 1998, 290, 2928, 286, 3098,...
[ 50256, 314, 10667, 645, 12, 505, 3114, 588, 257, 7417, 13, 447, 247, 198, 198, 447, 246, 2990, 714, 423, 1997, 739, 883, 1569, 4487, 13, 314, 1101, 407, 8066, 651, 2923, 287, 262, 1438, 286, 1964, 29409, 13, 447, 247, 198, 198, 1,...
[ 50256, 1011, 617, 15797, 2229, 284, 651, 257, 922, 4197, 13, 198, 198, 7454, 262, 2284, 20053, 318, 4197, 290, 262, 2962, 263, 318, 287, 1295, 11, 31833, 262, 31489, 29405, 13, 198, 198, 2504, 447, 247, 82, 340, 13, 383, 2962, 263, ...
[ 50256, 31293, 11, 23292, 22929, 658, 13, 770, 318, 262, 16638, 14078, 284, 4404, 11, 290, 262, 749, 1884, 11, 543, 1838, 340, 3338, 2323, 329, 9188, 290, 30855, 13, 198, 198, 1537, 11691, 11, 655, 329, 257, 2589, 11, 326, 2486, 318,...
[ 50256, 13, 198, 198, 6104, 607, 20409, 12127, 262, 13006, 1108, 286, 257, 2415, 351, 4274, 11131, 7370, 11, 10668, 4283, 35000, 357, 6738, 3203, 290, 3012, 11, 810, 673, 635, 3111, 828, 257, 860, 11, 830, 12, 23415, 12, 5898, 2156, ...
[ 50256, 13, 198, 198, 47462, 11, 257, 6868, 286, 370, 1324, 3889, 447, 247, 82, 17930, 11, 399, 13, 56, 1539, 5399, 262, 2297, 18075, 6205, 1080, 832, 262, 15994, 7712, 3961, 1430, 11, 290, 788, 6190, 832, 262, 21531, 1080, 878, 8415...
[ 50256, 340, 447, 247, 82, 1884, 530, 286, 4492, 447, 247, 82, 734, 45892, 481, 307, 1813, 517, 6110, 5798, 618, 503, 286, 7797, 13, 198, 198, 464, 3288, 582, 284, 466, 428, 318, 13329, 33925, 11, 508, 468, 9835, 3402, 465, 6110, 9...
[ 50256, 38019, 28378, 367, 3528, 38, 20913, 11, 13558, 2751, 705, 13918, 2200, 11682, 8779, 42, 4720, 5959, 10354, 1867, 3022, 373, 356, 547, 4385, 284, 307, 8072, 257, 2156, 326, 373, 284, 307, 3170, 329, 7288, 13, 2011, 9397, 290, 15...
[ 50256, 3256, 2427, 286, 655, 1016, 2651, 290, 4955, 262, 39043, 351, 257, 1295, 329, 606, 284, 2107, 13, 1318, 373, 1239, 257, 13019, 925, 284, 262, 39043, 9305, 262, 1109, 13, 198, 198, 6242, 24115, 50, 25, 4162, 318, 9738, 31586, ...
[ 50256, 379, 262, 886, 286, 9973, 338, 16298, 23784, 287, 9973, 4122, 1303, 20, 287, 262, 4274, 12, 7700, 4104, 319, 2443, 1987, 12, 1495, 357, 439, 2443, 10288, 287, 428, 2708, 389, 1912, 319, 262, 1621, 5468, 11, 407, 9048, 5468, 8...
[ 50256, 2254, 11, 475, 673, 338, 635, 10938, 546, 257, 7647, 1256, 13, 4231, 777, 38915, 393, 4738, 7188, 284, 607, 30, 1119, 3588, 470, 416, 597, 1724, 262, 749, 9204, 290, 2383, 10207, 287, 262, 1621, 13, 198, 198, 13518, 11, 356, ...
[ 50256, 1400, 13, 2773, 986, 1197, 526, 1148, 339, 31521, 41741, 986, 273, 674, 11428, 2415, 30, 198, 198, 1135, 821, 783, 19487, 832, 262, 968, 6740, 290, 257, 1178, 517, 7572, 2221, 284, 14740, 13, 4900, 356, 423, 1775, 607, 3067, ...
[ 50256, 644, 338, 673, 994, 329, 30, 1867, 338, 673, 2045, 379, 30, 317, 7779, 1336, 286, 473, 385, 1095, 30, 198, 198, 12442, 15219, 1058, 2080, 607, 649, 12, 9275, 2208, 12, 258, 1723, 11, 3115, 15219, 338, 20974, 416, 21815, 3101,...
[ 50256, 287, 1909, 338, 6257, 12407, 1410, 475, 3294, 3764, 38563, 13, 371, 13, 39, 13, 54, 13, 318, 612, 379, 257, 4688, 290, 6754, 2589, 25, 262, 4082, 286, 3764, 38563, 40892, 24238, 290, 8982, 9223, 354, 357, 7700, 1248, 11, 6103...
[ 50256, 290, 2705, 11, 290, 262, 1165, 12, 36194, 9958, 3721, 286, 15079, 2435, 13, 6674, 262, 18437, 318, 287, 326, 366, 28177, 8915, 812, 526, 2211, 481, 1317, 262, 5441, 400, 11162, 286, 14951, 338, 8886, 287, 28017, 11, 290, 314, ...
[ 50256, 3271, 5172, 290, 12246, 13685, 518, 1362, 447, 247, 82, 9162, 3348, 319, 281, 2620, 287, 968, 8221, 447, 247, 82, 1181, 5288, 7699, 422, 720, 19, 13, 1495, 284, 720, 20, 13, 2713, 13, 5172, 290, 13685, 518, 1362, 547, 5213, ...
[ 50256, 26, 2321, 828, 543, 423, 13242, 326, 389, 2092, 284, 360, 3266, 11, 36508, 11, 290, 24560, 357, 10333, 8, 290, 584, 12336, 3640, 13, 198, 198, 3198, 1744, 19976, 318, 326, 416, 625, 12, 17143, 2357, 2890, 357, 72, 13, 68, 1...
[ 50256, 466, 407, 13, 10832, 12, 34435, 4981, 460, 5412, 428, 1917, 611, 262, 13453, 468, 1366, 319, 262, 5087, 326, 389, 3917, 351, 262, 22577, 12695, 286, 5288, 12, 21482, 3657, 393, 611, 777, 5087, 466, 407, 1487, 625, 640, 357, 2...
[ 50256, 12, 34435, 4981, 290, 29052, 6096, 284, 7267, 326, 12336, 3640, 326, 2291, 4067, 12, 11423, 640, 11257, 357, 15410, 29569, 287, 517, 3703, 287, 262, 1306, 2665, 8, 743, 2148, 15679, 7184, 7746, 611, 262, 10033, 2928, 286, 2458, ...
[ 50256, 304, 1102, 16996, 37990, 3520, 11, 290, 286, 1781, 3169, 388, 668, 11, 8920, 2044, 11, 290, 1854, 2555, 284, 4404, 5969, 12, 34435, 3640, 319, 262, 9384, 326, 262, 29275, 287, 777, 13523, 389, 407, 8904, 13, 383, 4688, 5963, ...
[ 50256, 286, 2035, 262, 2717, 393, 1181, 5288, 7699, 287, 257, 1813, 1181, 13, 18581, 82, 351, 6632, 1411, 2458, 389, 15009, 422, 11291, 317, 13, 8090, 25, 6434, 447, 247, 82, 16765, 422, 262, 2059, 286, 11867, 3337, 329, 30627, 4992, ...

End of preview. Expand in Data Studio

ELF OpenWebText — GPT-2 tokens

Tokenized OpenWebText used by the ELF GPT-OWT experiments: 8,730,966 training sequences and 110,453 validation sequences. The single input_ids column contains lists of int32 GPT-2 token IDs. These Parquet files preserve the existing processed dataset's values, schema, and row order; no retokenization was performed.

from datasets import load_dataset

train = load_dataset("yresearch/owt-gpt2", split="train")
validation = load_dataset("yresearch/owt-gpt2", split="validation")

Source: Skylion007/openwebtext, credited upstream to Gokaslan, Cohen, Pavlick, and Tellex (2019). The upstream CC0 declaration covers dataset packaging; the upstream authors do not claim ownership of the extracted web text. See the upstream card for its copyright notice and takedown policy.

data_manifest.json records the split sizes, feature types, and shard SHA-256 hashes.

Downloads last month: 57