[Updated: Wed, Sep 20, 2023 - 17:31:16 ]
Generating features from text data is very different than dealing with continuous and categorical data. First, let’s remember the dataset we are working with.
readability <- read.csv(here('data/readability.csv'),header=TRUE)
# The first two observations
readability[1:2,c('excerpt','target')]%>%
kbl(format = 'html',
escape = FALSE) %>%
kable_paper(c("striped", "hover"),full_width = T) %>%
kable_styling(font_size = 14)| excerpt | target |
|---|---|
| When the young people returned to the ballroom, it presented a decidedly changed appearance. Instead of an interior scene, it was a winter landscape. The floor was covered with snow-white canvas, not laid on smoothly, but rumpled over bumps and hillocks, like a real snow field. The numerous palms and evergreens that had decorated the room, were powdered with flour and strewn with tufts of cotton, like snow. Also diamond dust had been lightly sprinkled on them, and glittering crystal icicles hung from the branches. At each end of the room, on the wall, hung a beautiful bear-skin rug. These rugs were for prizes, one for the girls and one for the boys. And this was the game. The girls were gathered at one end of the room and the boys at the other, and one end was called the North Pole, and the other the South Pole. Each player was given a small flag which they were to plant on reaching the Pole. This would have been an easy matter, but each traveller was obliged to wear snowshoes. | -0.3402591 |
| All through dinner time, Mrs. Fayre was somewhat silent, her eyes resting on Dolly with a wistful, uncertain expression. She wanted to give the child the pleasure she craved, but she had hard work to bring herself to the point of overcoming her own objections. At last, however, when the meal was nearly over, she smiled at her little daughter, and said, “All right, Dolly, you may go.” “Oh, mother!” Dolly cried, overwhelmed with sudden delight. “Really? Oh, I am so glad! Are you sure you’re willing?” “I’ve persuaded myself to be willing, against my will,” returned Mrs. Fayre, whimsically. “I confess I just hate to have you go, but I can’t bear to deprive you of the pleasure trip. And, as you say, it would also keep Dotty at home, and so, altogether, I think I shall have to give in.” “Oh, you angel mother! You blessed lady! How good you are!” And Dolly flew around the table and gave her mother a hug that nearly suffocated her. | -0.3153723 |
The excerpt column includes plain text data, and the target column includes a corresponding measure of readability for each excerpt. A higher target value indicates a more difficult text to read. What features can we generate from the plain text to predict its readability?
In the following sections, we will briefly touch on the Transformer models and demonstrate how to derive numerical features to represent a text.
1.Natural Language Processing
NLP is a field at the intersection of linguistics and computer science with the ultimate goal of developing algorithms and models to understand and use human language in a way we understand and use it. The goal is not only to understand individual words but also the context in which these words are being used.
The recent advancements in the field of NLP revolutionized the language models. These advanced language models take plain text, put it into smaller pieces (tokens), then use very complex neural network models to convert these tokens into a numerical vector representing the text.
Most recently, a group of scholars called these models as part of Foundation Models. Below shows a development timeline of the most popular language models.
Below is a brief list of some of these NLP models and some information, including links to original papers. These models are very expensive to train and use the enormous amounts of data available. For instance, Bert/Roberta was trained using the entire Wikipedia and a Book Corpus (a total of ~ 4.7 billion words), GPT-2 was trained using 8 million web pages, and GPT3 was trained on 45 TB of data from the internet and books.
| Model | Developer | Year | # of parameters | Estimated Cost |
|---|---|---|---|---|
| Bert-Large | Google AI | 2018 | 336 M | $ 7K |
| Roberta-Large | Facebook AI | 2019 | 335 M | ? |
| GPT2-XL | Open AI | 2019 | 1.5 B | $ 50K |
| T5 | Google AI | 2020 | 11 B | $ 1.3 M |
| GPT3 | OpenAI | 2020 | 175 B | $ 4.6 M |
All these models except GPT3 are open source. They can be immediately utilized using open libraries (typically Python), and these models can be customized to implement specific tasks (e.g., question answering, sentiment analysis, translation, etc.). GPT3 is the most powerful developed so far, and it can only be accessed through a private API, https://beta.openai.com/.
You can explore some GPT3 applications on this website, https://gpt3demo.com/. Below are a few of them:
Artificial tweets (https://thoughts.sushant-kumar.com/word)
Creative writing (https://www.gwern.net/GPT-3)
Interview with (artificial) Einstein (https://maraoz.com/2021/03/14/einstein-gpt3/)
If you have time, this series of Youtube videos provide some background and accessible information about these models. In particular, Episode 2 will give a good idea about what these numerical embeddings represent. If you want to get in-depth coverage of speech and language processing from scratch, this freely available book provides a good amount of material. Finally, this free course by Hugging Face provides a nice an easy introduction to transformer models. While the course primarily utilizes Python, it is still useful to read through to get familiar with concepts.
In this class, we will only scratch the surface and focus on the tools available to make these models accessible through R. In particular, we will use reticulate package and sentence_transformers module (a Python package) to connect with HuggingFace’s Transformers library and explore the word and sentence embeddings derived from the NLP models.
You can consider Hugging Face like a CRAN of pre-trained AI/ML models, it includes a wide variety of language models. There are thousands of pre-trained models that can be imported and used within seconds at no charge to achieve tasks like text generation, text classification, translation, speech recognition, image classification, object detection, etc.
2. Text Encoding the reticulate package and sentence_transformers
First, we will load the reticulate package and sentence_transformers module. While we import the sentence_transformers module we will assign a name to save as an object so we can utilize it moving forward.
require(reticulate)
st <- import('sentence_transformers')Next, we will pick a pre-trained language model to play with. It can be any model listed in the previous section. You have to find the associate Huggingface page for that particular model and use the same tag used for that model. For instance, suppose we want to use the RoBERTa model. The associated Huggingface webpage for this model is https://huggingface.co/roberta-base.
Notice that the tag for this model is ‘roberta-base’. Therefore, we will use the same name to load this model. For other models, you can use the search bar at the top. When you run the code in the next chunk the first time, it will install all the relevant model files (https://huggingface.co/roberta-base/tree/main) to a local folder on your machine. The next time you run the same code, it will quickly load the model from the local folder since it is already installed on your computer.
model.name <- 'roberta-base'
roberta <- st$models$Transformer(model.name)
pooling_model <- st$models$Pooling(roberta$get_word_embedding_dimension())
model <- st$SentenceTransformer(modules = list(roberta,pooling_model))One important thing to be aware of about these models is the maximum number of characters they can process. It can be found by using the following code. For instance, RoBERTa can handle a text sequence with a maximum number of 512 characters. If we submit any text with more than 512 characters, it will only process the first 512 characters.
model$get_max_seq_length()[1] 512Another essential characteristic is the length of the output vector when a language model returns numerical embeddings. The following code reveals that RoBERTa returns a vector with a length of 768.
model$get_sentence_embedding_dimension()[1] 768In short, RoBERTa can take any text sequence up to 512 characters as input and then return a numerical vector with a length of 768 that represent this text sequence. This process is also called encoding.
For instance, we can get the embeddings for a single word ‘sofa’. The following will return a vector with a length of 768.
model$encode('sofa') [1] -0.0356739610 0.0091452915 0.0451551154 -0.0228319988
[5] 0.4442713559 -0.2135011852 0.0167765897 -0.0311041381
[9] 0.0107637532 -0.1096956134 -0.2183851302 -0.1140032262
[13] 0.1238908470 -0.0797361359 0.1692416519 0.0336829498
[17] -0.0600813031 0.0623767339 0.0907270387 -0.0224188231
[21] -0.0487387851 0.1461644173 -0.0409476534 0.0489805304
[25] -0.0786152929 -0.0014594514 0.1224116161 0.0160395801
[29] -0.0279184822 -0.0633803979 -0.2180166543 -0.1305485517
[33] 0.0690473542 -0.0019865464 0.0430623516 0.0606660955
[37] 0.0769219324 0.0823243707 -0.0091244802 0.0740725845
[41] -0.0998382196 0.0193559173 -0.1617818475 0.0065892581
[45] -0.0066350996 -0.0094996877 0.1424297392 -0.1620815396
[49] 0.0353107899 -0.0427614897 0.0912168026 -0.0695206448
[53] -0.0678907335 0.0852721781 -0.0525358729 -0.1284755319
[57] 0.0785271227 -0.0650885701 -0.0774637461 0.0362805724
[61] -0.0768732131 0.5039720535 -0.0417392813 0.0190712139
[65] -0.0342553258 0.0591300614 -0.0683486015 0.2984635830
[69] 0.1031861901 -0.0457865521 0.0050541554 -0.0820528343
[73] 0.0670195296 0.0963044539 -0.0055563236 -0.0143450852
[77] 0.0891769677 -2.4715216160 -0.1521035582 0.0507060960
[81] 0.0713680387 -0.0759579390 0.6373476386 0.1234835237
[85] 0.0974773467 0.0023111589 0.0176451337 0.2336518466
[89] -0.0200673547 0.0513754599 0.0578624979 0.0382901579
[93] 0.0388909206 0.0787570849 0.0269535370 0.0421335399
[97] -0.0185404010 0.3166861236 -0.0640645251 0.0246435348
[101] -0.0877356082 -0.0269688834 0.0998412147 0.0831300467
[105] -0.1081224978 0.1028029099 -0.1278326511 -0.0900091380
[109] -0.1370072365 -0.0222846027 -0.1231006011 0.2747447789
[113] 0.1733784825 -0.0460299775 -0.0388567075 0.0479775555
[117] -0.0237231664 0.0516280644 0.0417753085 0.1405762136
[121] 0.0398786888 0.1218406260 0.1547902524 -0.0799253136
[125] -0.2430792302 0.0188864060 0.1381260455 -0.0364184044
[129] -0.0737973154 0.0934374630 -0.0591127388 -0.1949139088
[133] -0.0084962826 0.1367645711 0.0814273059 -0.0439461172
[137] -0.0625772253 0.0191264357 0.1192571372 -0.0691679865
[141] 0.0121560153 0.0242042560 0.1154776216 -0.0031788489
[145] 0.1741372645 -0.0381856300 0.0096333232 -0.0517109446
[149] -0.2065927684 0.2168765217 0.1562301964 -0.1177057773
[153] 0.0559231862 -0.0408602990 -0.0578732491 0.1034204736
[157] 0.1974046826 0.0587377064 -0.0360219218 -0.0513394848
[161] 0.0466131195 -0.1661968976 0.0014134059 0.0006979322
[165] -0.0763303414 0.0016987236 0.0691462085 0.0510523655
[169] -0.0452497005 0.0557559207 -0.0133551341 0.0120415296
[173] -0.0284588616 0.0128517095 0.0009869952 -0.0887095928
[177] 0.0629096702 -0.0487924740 -0.0417405814 -0.0330066457
[181] -0.0286348350 -0.0158590674 -0.1413763165 -0.0421915129
[185] 0.0825778693 0.0744538307 -0.0357263014 -0.1307719201
[189] -0.1297859699 0.0350345746 0.1615838110 0.0179401282
[193] -0.0293479897 -0.0170247853 0.0378078744 0.0269139335
[197] -0.1672320217 -0.0403192937 -0.0556905754 -0.0660827383
[201] -0.0173227638 -0.0607024953 0.1821020246 0.0161704849
[205] 0.2305682898 -0.0419338197 -0.1288991123 0.0448455289
[209] 0.0064716600 -0.0127650741 -0.0925187841 0.1807894111
[213] 0.0710934252 0.1928009093 -0.1210669428 -0.1314722449
[217] -0.0510648154 -0.4452689588 0.1560137719 -0.2141953409
[221] 0.0473200753 0.0048588449 -0.1239974946 -0.1737168282
[225] -0.1687250882 -0.1179471463 0.0520940572 0.0320896581
[229] 0.0264194682 -0.0294446461 0.1118273884 0.1000626013
[233] 0.2142880708 -0.0209907908 0.1219721958 -0.0776944458
[237] -0.0059377681 0.0226883367 -0.0174616352 0.0608575717
[241] 0.0128563922 -0.0122666284 0.0205464363 0.1535492539
[245] -0.0558923967 0.0173551757 -0.0106957164 0.3792691827
[249] -0.0184841342 -0.0758697316 -0.0823302120 -0.0419104174
[253] 0.0146229882 -0.0516287647 -0.0121405581 0.0141355302
[257] -0.0988652408 0.0112233525 0.0774115101 0.1352834553
[261] 0.0283605196 -0.0186086819 -0.0428918973 -0.1596861631
[265] -0.0418169945 -0.0641659349 0.0253907926 0.0114793517
[269] -0.0815594047 -0.0027431045 0.1337629259 -0.0245217867
[273] 0.0282561723 -0.0723891556 0.0336038843 -0.0491962805
[277] 0.2089185268 -0.0338551402 -0.0591803417 -0.0615116805
[281] 0.0708776638 0.0354636088 -0.1486814171 0.0963897035
[285] 0.0737084821 0.0070018056 0.2741011083 -0.0709664822
[289] -0.0759047121 0.0596543550 0.0633541495 0.1221976727
[293] 0.0663689300 -0.0255231652 -0.0601295643 -0.0410300568
[297] 0.0213434175 -0.0070217536 0.0664876178 0.0375904702
[301] 0.0977534801 -0.0357051492 -0.0466797203 0.0041690161
[305] 0.1315060258 -0.0527024977 -0.0580320247 0.0049279444
[309] -0.0824159011 0.0807028711 0.0243882202 0.0074504651
[313] -0.0792178810 0.0894088000 0.0450709686 0.0140973330
[317] -0.1279232353 0.0452108681 0.0370465592 0.0794232488
[321] 0.0484420918 -0.0275568068 0.0909292921 0.1273204237
[325] -0.0044540651 0.0747541636 0.0438659079 0.0720247105
[329] -0.0906757563 0.1686510891 -0.0826850086 0.4302483201
[333] 0.1092576087 0.0815252513 0.1608462334 0.2359179258
[337] 0.0666487738 -0.0231011249 0.1278099120 0.1643448323
[341] -0.0311187897 -0.0091495812 -0.0372512080 0.0233513340
[345] 0.1186399907 0.0678060576 0.0010681981 -0.0119118299
[349] 0.0046485681 0.0117309950 -0.0047438201 0.0092348186
[353] -0.0281289481 -0.1587170810 -0.0635980815 0.2193659097
[357] 0.0223285761 0.1418938637 -0.0243899096 0.1697532982
[361] 0.0401152596 0.0707843602 0.0132805128 -0.0120259793
[365] 0.1322512329 -0.0730908960 -0.1636713296 -0.0757417679
[369] 0.0443388149 0.1403741688 0.0351632163 0.0272783544
[373] -0.0755953714 0.0670917109 0.0744388178 -0.0585914142
[377] 0.0665109158 0.0554741733 0.1915322989 0.0042239279
[381] 0.0241412483 0.0870938003 0.0407261923 0.0380898938
[385] 0.0072629489 0.2295169532 0.0345601663 0.1345981061
[389] 0.0193038937 -0.0737601519 0.0488900095 -0.0320191570
[393] 0.0044139400 -0.1239226386 0.1697745770 -0.0467690229
[397] 0.1255642921 0.0495714769 -0.1245959699 -0.0278481580
[401] -0.0222749729 0.0756490007 -0.0419671908 0.1577912569
[405] 0.1263415068 0.0471821725 -0.0791757703 -0.0848639980
[409] 0.0489037707 -0.0662666783 0.0232489593 0.1550576985
[413] 0.0583984405 0.0501303114 -0.1187660545 -0.1089226231
[417] 0.0051808371 0.1294556260 -0.0263066702 0.0613578483
[421] -0.1572146863 0.1188179851 -0.0304358322 -0.0012861080
[425] 0.0322567225 -0.0624186099 0.1952621043 -0.1082454026
[429] 0.0215926021 0.0031448025 0.0534361675 -0.0518163294
[433] -0.0187338796 0.0358905196 0.1152749881 -0.0206493009
[437] -0.0183112808 -0.0602562875 -0.0933917016 0.0276018120
[441] -0.0309239589 0.0220303740 -0.0335549340 0.1210290939
[445] -0.0852393284 -0.1197768748 0.0796097219 -0.0185298547
[449] -0.0533546135 0.0326319411 0.0140433479 0.0901376978
[453] -0.0106399208 -1.2948679924 0.0549269058 0.2028155327
[457] -0.0292813182 -0.0242747366 -0.2009219229 0.0069828127
[461] -0.0131280888 0.0950084254 -0.0167004801 -0.1093979999
[465] 0.0556762479 -0.0704313815 0.1441860497 0.0586875789
[469] 0.0131810829 -0.0256288871 0.0765602812 -0.0727991164
[473] 0.0087057045 -0.0679870248 -0.0487150811 -0.0322923847
[477] 0.0067269527 0.2760896981 0.1456675082 -0.1109817624
[481] 0.0296200737 0.0961446464 0.1258685142 0.0100035518
[485] -0.0643155798 -0.0085830279 -0.0160746835 0.1137120202
[489] 0.0430779532 -0.1941830814 0.0519818999 -0.1093629897
[493] -0.0540313534 0.0003336649 0.2005086243 0.0755024254
[497] 0.0308930520 -0.1000531092 0.0408554040 -0.0952554420
[501] 0.0385358930 0.0117233684 0.0151376864 0.0827608109
[505] -0.0540767983 -0.0203211699 -0.0348391049 -0.0059033292
[509] 0.0453390293 0.1632901579 0.1114752591 -0.0287137758
[513] 0.0790089965 0.0042176861 -0.0153378677 -0.1155088916
[517] 0.2205435038 -0.0161970071 -0.2082663924 -0.2145530879
[521] 0.0687874034 -0.0167665780 0.0280568413 -0.1220358312
[525] -0.2078153938 -0.0163571201 -0.0281453505 0.0477408022
[529] 0.1477197260 -0.0380651988 -0.0686690956 -0.1238215193
[533] 0.0485135168 -0.0375833437 -0.0017912239 0.0233479757
[537] 0.1342128366 0.0435455702 -0.2266585380 -0.0229836479
[541] -0.1091297865 0.0042014066 0.0208422765 -0.0898816288
[545] 0.0692565739 0.0958191231 -0.0390331931 0.0037433216
[549] -0.0514277034 -0.0427649952 0.0874260515 -0.2977560759
[553] 0.0617639646 -0.0038292734 0.1614622623 0.0619579367
[557] 0.0771042630 -0.1935174614 -0.0958970934 0.2438838184
[561] -0.0766469017 0.2058261037 0.0610172190 -0.0550224334
[565] -0.0674731657 0.1120143756 0.1977238506 0.0133913057
[569] -0.0182942767 0.0311765596 -0.0793673620 -0.0004061926
[573] -0.1822259128 0.0842015147 -0.0151702296 0.0315816365
[577] 0.0143520888 0.0462132841 0.1367394030 -0.1292865872
[581] -0.1191602945 0.0113026714 0.0500270873 0.0091564078
[585] 0.0946571678 0.1466214955 -0.0994028375 0.0686461106
[589] 10.4880447388 -0.0123514729 -0.0012773862 0.0908007324
[593] -0.0558971688 -0.1602755934 -0.0279271528 -0.0967928693
[597] 0.1088774577 -0.0242510661 -0.0238485262 0.0940334499
[601] -0.0809688866 0.0916284621 0.0230508875 0.0944304019
[605] 0.1266701519 0.0251529813 0.1540278941 0.0799024925
[609] -0.0092427004 -0.1325678527 -0.0278560482 0.0196429603
[613] -0.0994739532 -0.0079187285 0.0675237849 0.0466950536
[617] 0.0014124722 0.2096044570 0.0467524007 0.1765374392
[621] -0.0125307851 -0.0876224935 -0.0425623730 -0.0767806694
[625] -0.2339251786 0.0408395901 -0.0243873447 0.1549460888
[629] 0.0910378993 0.0292610079 0.0766360164 -0.0269176289
[633] 0.0165668949 0.0711876675 -0.0904418379 0.0709702373
[637] -0.1378541440 -0.0377802700 -0.0319465138 -0.1898437291
[641] 0.0096299518 0.1230707169 -0.1166381687 0.0054549370
[645] 0.2066617906 -0.0204732902 0.0302161332 -0.0745335370
[649] 0.0918245688 0.0983860195 -0.0038088528 0.1738650054
[653] 0.1944436133 -0.0272036064 0.1342483014 -0.0183334164
[657] 0.0908793360 0.0922514722 -0.0001281835 0.0130358934
[661] -0.0195043273 0.0827303976 -0.0225233156 -0.1205918044
[665] -0.3059235811 -0.0033967942 0.0108995540 -0.1303331256
[669] 0.0572650544 0.1016918644 -0.0377703272 0.1106682941
[673] 0.0756958127 0.0101066353 0.2055893093 0.1658867449
[677] -0.0501063056 0.0134348497 0.0426327512 0.0528929085
[681] 0.0533999354 0.0504605025 0.1714175940 0.0124473581
[685] -0.0630341023 -0.0481487587 0.0119474344 -0.0312205367
[689] -0.0983770266 -0.0657716990 0.0097869402 0.0815106332
[693] -0.0783884451 0.1317924112 0.1393555254 0.0091066100
[697] 0.1090818569 0.0826683417 -0.0873613730 0.0406477526
[701] 0.0024024630 0.0293322615 -0.0107911229 -0.0422949791
[705] 0.0773078799 0.0439093374 0.0041232221 -0.0003319718
[709] -0.0733481720 0.0519525483 -0.1517664492 0.0979920477
[713] 0.1458352655 0.0452605821 -0.0459416397 -0.0361512005
[717] -0.0092587732 -0.0254314225 -0.1035516784 0.0726805553
[721] 0.0867970884 0.0103221089 0.0760935023 -0.0238303263
[725] -0.0003891811 -0.0292554908 -0.1475816667 0.0020689443
[729] -0.1005423963 0.1260626465 0.1335250735 -0.0404047295
[733] 0.0887767822 -0.0295703020 -0.0424162671 -0.0948930085
[737] -0.0572368279 0.0164915603 -0.0415635332 0.0422985479
[741] -0.0588609762 0.1055561453 0.0921511501 0.0129698375
[745] -0.0341896787 -0.0933145285 0.0428062342 -0.1376243681
[749] -0.0494870879 -0.5013434291 0.1010253131 -0.1516790539
[753] -0.1601956934 -0.0478142425 -0.0450621769 -0.0462121964
[757] 0.2260329872 -0.1113839298 0.0209654514 0.0178512931
[761] 0.0428405628 0.1008379236 0.0504300594 0.0481586978
[765] 0.2165928781 -0.1681894660 -0.0393629372 -0.0666962191Similarly, we can get the vector of numerical embeddings for a whole sentence.
model$encode('I like to drink Turkish coffee') [1] -0.01178756263 0.10278499871 0.01093375869 -0.04623499140
[5] -0.00487077981 -0.04498281330 0.08225313574 -0.03068084642
[9] 0.00254547270 -0.07485476881 0.00626886077 -0.16109354794
[13] 0.07325114310 -0.00854813121 0.04085500538 0.28260263801
[17] 0.11343766004 0.13471494615 0.07055664062 0.36907771230
[21] -0.02329965308 0.12997290492 -0.08797073364 0.00176735315
[25] -0.13596564531 0.05665922537 0.11902851611 -0.01500649936
[29] 0.13772100210 -0.00496985437 -0.08434423804 -0.07868374884
[33] 0.02161235362 -0.03984801471 0.04456693679 0.05849874020
[37] 0.11640743166 0.02286028862 -0.00947276782 0.00502380542
[41] 0.04630419612 -0.32184061408 -0.02034790069 0.01740729809
[45] 0.01355001330 -0.04638009891 -0.05697692558 -0.14055319130
[49] 0.07457129657 -0.01287342701 -0.01593326218 0.07576484978
[53] 0.02938880213 0.04194469377 -0.05589605868 0.03272417933
[57] 0.03844407946 0.05413730443 0.12071878463 -0.07491374761
[61] 0.01938630454 0.54147577286 -0.15505477786 0.05381580815
[65] 0.04042135552 -0.00642709574 -0.00746040652 -0.12155018747
[69] -0.02452480420 0.10893430561 0.03051396087 -0.08853682876
[73] 0.04928927124 -0.08943001181 0.01897253469 0.07131873071
[77] 0.06871882826 -4.13642501831 0.13351145387 0.07664902508
[81] 0.03651222214 -0.09673640132 0.89217787981 -0.04306836054
[85] 0.04194186255 -0.05514504015 -0.02103988640 0.17559264600
[89] 0.01227049716 -0.00386030739 0.04441806674 -0.03551847115
[93] -0.07538413256 0.11143504083 0.04939413816 0.03816314042
[97] 0.09854111820 -0.02303134464 -0.00179665210 -0.00085414201
[101] -0.11806513369 -0.02063305676 0.02362795174 0.09661674500
[105] 0.01085869595 -0.12519752979 0.10698405653 -0.03740838915
[109] -0.08884917200 0.13770172000 0.10585375130 -0.09237524122
[113] 0.14154621959 -0.00389125478 -0.05083238333 0.07898531109
[117] 0.04267026484 0.05936061218 -0.06123913825 0.06296721101
[121] 0.05586537346 0.03252293542 0.14736802876 0.07342395186
[125] -0.25260412693 -0.08185942471 0.04785029590 -0.03871662542
[129] -0.01667318121 0.04311851785 -0.04991150647 -0.60922294855
[133] -0.00484278006 -0.06470596045 -0.00291156583 -0.11511138827
[137] -0.01698307693 -0.03271684051 -0.05950184911 -0.12982320786
[141] 0.01724223420 0.03518041596 0.02934072725 0.04171930999
[145] 0.30440011621 0.02517579868 -0.07006555051 -0.23346969485
[149] 0.00844197161 0.05099269748 0.03252385557 -0.04751272500
[153] -0.07027619332 0.08984416723 -0.06273024529 0.14591774344
[157] 0.09863515198 0.25520563126 -0.07795181870 0.43738499284
[161] 0.12964035571 0.01454514638 0.01953442395 -0.02825888619
[165] 0.00075821672 0.00771219516 -0.01024915092 0.04318773746
[169] 0.07650490105 0.08267024904 -0.00568555202 0.03067611344
[173] -0.04012656957 0.14161375165 0.01266532484 -0.13634182513
[177] -0.03952530026 0.09026617557 0.00772870053 -0.01258897781
[181] 0.06947132200 0.05105271935 0.00032814220 0.00196462078
[185] -0.01595257409 0.11271636188 0.15407632291 0.05832265317
[189] 0.11283170432 0.04487172142 -0.04882197082 0.05088605359
[193] -0.02264021337 0.07404132932 0.07896973193 0.10499487817
[197] -0.06692550331 -0.03697898984 0.06937737763 0.04945894331
[201] 0.05113966018 -0.08194012195 -0.10721433163 -0.04897894710
[205] 0.15065754950 0.10129641742 0.02087124810 0.10874668509
[209] 0.04760009423 -0.06162553653 -0.09491002560 -0.12216342241
[213] -0.02830585092 0.03591910750 -0.04520691186 -0.16342914104
[217] 0.06836596876 0.04436348751 0.04822815955 0.41608574986
[221] 0.07999478281 0.04446204752 -0.09777959436 0.00191505952
[225] -0.08722338080 0.11013680696 0.14092494547 -0.07029317319
[229] 0.15053604543 -0.16089598835 -0.02733201906 -0.04974053055
[233] -0.10599211603 0.07982736826 0.09201110154 -0.40470686555
[237] 0.05906889960 -0.01318830065 0.01357291173 -0.02731262147
[241] -0.65026259422 0.08871906251 0.08232256770 0.07668064535
[245] 0.04042013362 0.02460350096 -0.00144912163 0.17354218662
[249] 0.14589069784 -0.04771002010 0.01597190090 0.08966311067
[253] 0.04908165336 -0.11419168115 -0.08502776921 -0.08974553645
[257] -0.12737628818 0.04935332388 -0.15694443882 -0.06124186516
[261] 0.03666267172 0.02004068159 0.04401797429 -0.15641340613
[265] -0.05760531500 0.07650154829 -0.03167368472 0.07931122184
[269] 0.00901504979 -0.06132012978 0.01697015762 -0.02927378938
[273] -0.04857507348 0.02371818013 0.03179942816 -0.04552056640
[277] 0.17627295852 -0.02516534552 -0.05752530321 -0.01505636424
[281] 0.08774642646 -0.02125256509 0.18481005728 0.08228832483
[285] 0.06763889641 0.01308839396 -0.13039453328 -0.03017592058
[289] -0.01873817667 0.08929710090 0.05834455416 -0.03174070269
[293] 0.01390640810 -0.03864267841 -0.09253222495 -0.01728121378
[297] 0.12410937250 -0.04100821540 0.04707189649 0.04714074731
[301] 0.10770967603 -0.00315346196 -0.10042775422 0.08935348690
[305] -0.01404160354 -0.04688004032 -0.07279075682 0.05749002844
[309] -0.06967109442 -0.05545315892 -0.02552834339 -0.14972683787
[313] 0.06309494376 0.15150888264 -0.00864394754 0.01057897694
[317] 0.00592292240 0.00970546529 0.08703348786 0.03069057688
[321] -0.03375400230 -0.06739930809 0.09072256833 0.07848568261
[325] 0.11284592748 -0.08407180011 0.07819942385 0.03995769098
[329] 0.07009632140 0.11188885570 -0.24580949545 0.90001469851
[333] 0.12089532614 -0.01227924973 -0.06359811872 0.03523534164
[337] 0.01611461677 0.08675729483 0.10483931005 0.01012298930
[341] 0.00031804154 -0.00818176940 -0.16627056897 0.00469068484
[345] 0.02130271308 0.07732348144 0.04926919565 -0.05670228973
[349] -0.04631502181 0.10687955469 -0.03332764655 0.01406783424
[353] 0.09957949817 -0.15667900443 -0.00317216013 0.01619793475
[357] 0.13785058260 -0.03695226461 0.01658136211 -0.06813907623
[361] 0.08336272836 0.16922046244 0.00247423816 -0.08443702757
[365] 0.05174981058 0.09740118682 0.26251202822 0.13505578041
[369] -0.04359325022 0.09619217366 0.03377174959 -0.00218817405
[373] -0.01017327979 -0.08413492888 -0.05180362985 -0.07273145020
[377] 0.05030424520 0.08751272410 0.16093406081 -0.03390208632
[381] -0.01043029781 -0.03548621386 -0.01699107513 0.01912876405
[385] -0.07973151654 0.04320683703 0.01989768445 -0.12756203115
[389] -0.03098621033 0.00650840718 -0.07768756151 0.10089147091
[393] -0.07954857498 -0.01790400781 0.01669675484 0.05395016819
[397] 0.03829964250 0.14281614125 0.20642946661 -0.05247383565
[401] 0.04683664814 0.10827600211 -0.06957665086 -0.07571008056
[405] -0.05944715440 -0.01344989147 -0.07810124010 -0.04226115346
[409] -0.15824672580 -0.03212283924 0.09794007242 0.09059050679
[413] 0.01046781149 0.00020543486 -0.06280449033 0.02410167083
[417] -0.05018439144 -0.06793823093 0.00573871192 -0.03653944656
[421] 0.02161061764 -0.01924452372 0.04822736979 0.02471604571
[425] 0.12235145271 0.04452153668 0.13469699025 0.01670137979
[429] -0.02470082045 -0.05284336954 -0.10143402964 0.00922968425
[433] 0.03362737596 -0.04423018172 -0.00413170224 -0.01949813962
[437] 0.00942119583 -0.20146682858 -0.05510338396 0.01366847288
[441] -0.04772661254 0.07698956877 0.06640637666 0.02397813834
[445] -0.14183472097 -0.04575728625 -0.15320336819 -0.00788022485
[449] 0.02135960758 -0.01345346309 0.10530500114 -0.01646697707
[453] -0.03888763115 -1.08305180073 -0.00083741685 0.11160721630
[457] 0.02770528942 -0.01054597273 -0.06605579704 0.04412012547
[461] 0.08192968369 0.04005576298 -0.05635560304 0.05495367944
[465] 0.01402659342 -0.15851949155 -0.03023152798 0.19572809339
[469] 0.01863588765 0.06902951002 -0.01266082004 0.02299657091
[473] -0.00470078411 -0.07729942352 0.01735690981 -0.00720282644
[477] 0.07002413273 0.09092012048 0.03493273631 0.06802241504
[481] -0.01505678706 0.02954206988 -0.01877148636 0.03480780497
[485] -0.10423323512 -0.07202734798 -0.01704173721 0.01502756495
[489] 0.04665532708 -0.06358810514 -0.01287578978 -0.05168087035
[493] -0.01075313706 -0.00320516946 0.19674751163 0.04860872403
[497] -0.41238608956 0.01066310983 0.32675898075 -0.06341576576
[501] 0.02628972009 0.01365064457 0.07002934068 -0.04391351342
[505] 0.07600034028 0.14016662538 -0.03555902466 -0.04067653418
[509] 0.09995693713 0.03394508362 0.05223489180 -0.25556266308
[513] 0.00745464209 -0.01409167238 0.02850508317 0.12841719389
[517] 0.02112706937 0.09976664931 0.02270895615 -0.25903543830
[521] -0.03593028709 0.07121115178 -0.01665394753 -0.01663682610
[525] -0.05931027979 -0.06853275001 0.06115171313 0.03058695793
[529] 0.13712780178 -0.09377148747 -0.06594183296 -0.06134198606
[533] 0.07561255246 -0.00017064391 -0.16877844930 0.04635048658
[537] 0.04027160257 0.13218209147 -0.03819207847 0.07642486691
[541] -0.02910984680 0.12374015898 0.05625952035 0.02131085657
[545] 0.18835608661 0.04942709580 0.12962301075 0.00504925707
[549] 0.04721711576 -0.08219789714 -0.04640511796 -0.12387338281
[553] -0.04727662727 0.01413739100 0.05141320080 -0.04458754510
[557] 0.03157661483 0.12638874352 -0.00524097309 0.08917185664
[561] 0.01452164445 -0.35762175918 -0.01392915286 0.04477771372
[565] -0.03660982102 0.01903883368 0.09178100526 0.05326319113
[569] -0.01747901738 -0.05025598407 -0.01110013016 -0.05249111727
[573] -0.03659915924 0.01587794907 -0.01250017527 0.02968469635
[577] 0.10908561200 0.14437158406 -0.14502903819 0.05590865389
[581] 0.07278285921 -0.04392333329 0.01164120249 0.17424646020
[585] 0.05410258844 0.07681672275 0.07232151926 -0.06711075455
[589] 10.07463550568 -0.01011656411 0.01704577543 0.10929690301
[593] 0.06012175232 0.05607127026 0.02889964171 -0.04166502133
[597] -0.00205596257 0.09235295653 -0.04838714749 0.05196825787
[601] -0.02444161847 0.01730557531 0.01771085337 0.01625886187
[605] -0.28358867764 0.08354127407 0.10569129139 0.01898630336
[609] 0.12275204062 0.03809059784 0.03666390106 0.12680123746
[613] -0.15032386780 0.21821279824 0.18539962173 0.05414790660
[617] -0.00749016646 0.08893932402 0.07488542795 0.05545224249
[621] 0.02915835194 0.00856588595 0.13660992682 0.15385082364
[625] -0.06263649464 0.08125825971 -0.00002325047 0.23185446858
[629] 0.03506195918 -0.09679391980 0.01323065255 0.00519346818
[633] 0.03788876534 0.05919850618 0.09609610587 0.05751947314
[637] 0.03957244754 0.01264949236 0.01535425242 -0.06162425131
[641] 0.02908030897 0.14106319845 -0.01901833341 0.11276496202
[645] -0.03936489671 0.00099390326 -0.00366679300 -0.01762092672
[649] -0.00928323530 0.07514175028 0.06850954145 -0.02549809590
[653] 0.08762409538 0.08077415079 0.06784472615 0.08132497966
[657] -0.01183548942 -0.00072143879 0.02146123536 0.11198233068
[661] -0.07392378896 0.03819230571 0.01816147566 -0.04830361903
[665] -0.19510628283 -0.04690299183 -0.07854089141 -0.05419109017
[669] 0.02331295051 -0.00938901678 0.07046185434 0.09199322015
[673] 0.21238797903 0.02792359702 0.11243189871 0.02591974288
[677] -0.00615646644 0.03513993695 0.14261384308 0.07364098728
[681] 0.10220479965 0.01609489322 0.02398936078 -0.02556908131
[685] 0.00179124018 -0.02348809317 0.08397649974 -0.08257681876
[689] -0.04396900907 0.04995858297 -0.05033384636 0.05998511612
[693] 0.11537389457 -0.01593917795 -0.06055822968 -0.16152115166
[697] -0.01114141382 0.02739814483 -0.01101099607 -0.04443185404
[701] -0.00682633510 0.04704710469 -0.02496541105 -0.08497899026
[705] -0.06010052189 0.06924650073 -0.03039424494 0.07574173063
[709] -0.00660725730 0.03008056991 -0.02600940131 0.03524253145
[713] 0.03677238151 -0.05480838194 0.04589191079 -0.05034032464
[717] -0.02219916880 0.00385648594 0.05007091165 0.08368641138
[721] 0.05869836733 -0.04817376286 0.00500276731 0.01969382726
[725] 0.02232522331 -0.00405918434 -0.03342300653 -0.05019075796
[729] -0.05556573719 -0.13569174707 0.05072744191 -0.48665577173
[733] 0.04441469908 0.02524072118 -0.14115256071 0.17032654583
[737] 0.07977185398 -0.06868468225 -0.03465748578 -0.05387150124
[741] -0.05741538852 -0.02516146377 0.15718893707 0.01091605332
[745] -0.04058590904 -0.01980805956 0.02870250493 -0.01669016480
[749] -0.03890883923 -0.60106384754 0.03322814405 0.02858895808
[753] 0.18336550891 0.12473639101 0.01609408110 0.08886212856
[757] 0.07076863199 0.00996986963 -0.06644231826 0.00503187347
[761] -0.02441483364 -0.03701018542 0.04051119834 0.03330204263
[765] 0.10524793714 0.11114552617 0.07725711912 -0.14208619297The input can be many sentences. For instance, if I submit a vector of three sentences as an input, the model returns a 3 x 768 matrix containng sentence embeddings. Each row contains the embeddings for a sentence.
my.sentences <- c('The weather today is great.',
'I live in Eugene.',
'I am a graduate student.')
embeddings <- model$encode(my.sentences)
dim(embeddings)[1] 3 768head(embeddings) [,1] [,2] [,3] [,4] [,5]
[1,] 0.017466936 0.18936765 0.05655781 -0.10007770 0.3477369
[2,] -0.116279386 0.15185139 0.02549255 -0.18140650 0.3024701
[3,] 0.004130477 0.09689271 -0.02288255 0.01698708 0.1297401
[,6] [,7] [,8] [,9] [,10]
[1,] 0.161116362 0.01379415 -0.06983393 0.21350072 -0.086530611
[2,] 0.007331764 0.03502100 0.09465420 -0.02342363 0.003951203
[3,] 0.100442544 -0.03860680 0.05823556 -0.10520023 -0.094153374
[,11] [,12] [,13] [,14] [,15]
[1,] -0.03210545 0.18931536 -0.082832702 -0.04288674 -0.05687425
[2,] -0.06632143 -0.14414917 -0.007048744 -0.07298838 0.11057709
[3,] -0.13373426 -0.02797971 -0.043431252 0.06593540 0.06813642
[,16] [,17] [,18] [,19] [,20]
[1,] -0.1995602 0.12531294 -0.25097796 -0.007122722 0.1272842
[2,] 0.1434624 0.02711638 0.06095798 0.015504715 0.3171880
[3,] 0.1352124 0.05530372 -0.05192044 0.129772440 0.1445196
[,21] [,22] [,23] [,24] [,25]
[1,] -0.02212711 0.02939240 -0.06768320 -0.031360045 -0.02374818
[2,] -0.11055427 0.17259933 0.06908871 0.007150877 -0.09578121
[3,] -0.19155622 0.08215951 -0.04485236 0.025491279 -0.07901977
[,26] [,27] [,28] [,29] [,30]
[1,] -0.01850537 -0.073677890 0.08197053 0.04476932 -0.01092185
[2,] 0.11460673 0.007118554 0.06077866 0.07339842 0.07566937
[3,] 0.14188063 -0.059332389 -0.07300105 0.02767119 0.05440608
[,31] [,32] [,33] [,34] [,35]
[1,] 0.0516919 -0.12200159 0.06565627 0.08309685 -0.0631547
[2,] -0.1437625 -0.07774637 0.12881884 0.03798771 -0.2033215
[3,] -0.1472241 -0.08245133 0.04026355 0.04781771 -0.1529378
[,36] [,37] [,38] [,39] [,40]
[1,] 0.00124214 0.21495906 0.02378797 0.41673407 0.10881428
[2,] 0.03539575 0.02797152 0.02694622 0.18206938 -0.00243298
[3,] 0.16710928 0.04931019 0.07693321 0.03029568 -0.03445346
[,41] [,42] [,43] [,44] [,45]
[1,] -0.02317035 -0.04610297 -0.07775073 0.09374794 0.01631867
[2,] 0.18405415 -0.09677307 0.02205182 -0.05291918 -0.12745722
[3,] 0.04713881 -0.10469180 0.01276998 -0.11525831 -0.12307585
[,46] [,47] [,48] [,49] [,50]
[1,] -0.08893959 -0.066087134 -0.033896975 0.03748417 -0.09860551
[2,] -0.05699166 0.026511583 0.005998232 0.04043084 0.09988649
[3,] -0.02619796 0.006607132 0.128890276 0.04518945 -0.02991036
[,51] [,52] [,53] [,54] [,55]
[1,] 0.01296319 -0.003461072 -0.02627736 0.01285952 -0.06320502
[2,] -0.03472668 0.126700595 0.05529476 0.04296899 0.01611242
[3,] 0.02033573 0.302788228 -0.01722694 0.13887501 -0.06220450
[,56] [,57] [,58] [,59] [,60]
[1,] 0.04111816 0.12291817 0.27477175 0.09285492 -0.05965450
[2,] 0.17848778 0.10158963 0.10257996 0.07757163 0.03783483
[3,] 0.08246204 0.02561423 -0.01797309 -0.01141094 -0.06575820
[,61] [,62] [,63] [,64] [,65]
[1,] -0.12136278 -0.05212643 0.01001978 -0.03749729 -0.08881954
[2,] -0.08906478 0.34973344 -0.18619291 -0.24437067 0.02749443
[3,] -0.10261139 0.16414776 -0.19891870 -0.09115140 0.15854540
[,66] [,67] [,68] [,69] [,70]
[1,] -0.024980947 0.08160084 0.14402378 -0.02253270 0.18326229
[2,] -0.007333713 0.05363137 0.07141103 0.01306976 0.14572120
[3,] -0.083556786 0.08434479 0.10600642 0.07140820 0.03421079
[,71] [,72] [,73] [,74] [,75]
[1,] 0.01987223 -0.10938195 0.05411881 0.02580995 0.05389390
[2,] -0.02115243 0.01261677 -0.01681857 0.05305029 -0.03361567
[3,] 0.04432295 0.18048577 -0.02966901 -0.11892220 -0.02450558
[,76] [,77] [,78] [,79] [,80]
[1,] 0.08346283 -0.06182058 -4.744359 -0.18744363 -0.17499693
[2,] -0.02086468 0.13247438 -3.307262 0.13413826 0.10885518
[3,] -0.14510953 0.16692485 -3.742653 -0.01816995 -0.04116233
[,81] [,82] [,83] [,84] [,85]
[1,] 0.14713387 -0.1248986 0.9754919 -0.06475981 0.05608290
[2,] 0.07537901 -0.2367227 1.3949689 0.06399761 0.13651498
[3,] 0.02652982 -0.2597603 1.3483980 0.19230933 0.02012401
[,86] [,87] [,88] [,89] [,90]
[1,] -0.30756178 0.11022718 0.171431765 0.06668350 -0.003124851
[2,] 0.06031471 0.04747717 -0.005528938 0.02481796 0.014205792
[3,] 0.03678771 0.16980240 0.151860595 -0.04821039 -0.004139557
[,91] [,92] [,93] [,94] [,95]
[1,] 0.04622074 0.090181261 -0.04604505 0.06580640 0.14173642
[2,] 0.06329937 0.008838675 -0.07240096 -0.06188769 0.09276354
[3,] 0.01915987 -0.135672256 -0.01942731 0.03034206 0.03634046
[,96] [,97] [,98] [,99] [,100]
[1,] 0.18965936 -0.04988672 0.5766389 -0.03957188 0.007752549
[2,] -0.06889861 -0.11589235 0.5682074 -0.07129852 -0.091406807
[3,] -0.07978459 -0.02496983 0.6747148 -0.05331716 -0.107529968
[,101] [,102] [,103] [,104] [,105]
[1,] -0.01312273 -0.01181763 0.1199985 0.14943148 -0.10740668
[2,] -0.05813193 0.01646996 0.1975683 0.20346186 -0.05206105
[3,] -0.01322445 -0.06349409 0.2546781 0.09124219 -0.03539053
[,106] [,107] [,108] [,109] [,110]
[1,] 0.02258746 0.04812491 -0.06409516 0.04273710 -0.01460021
[2,] 0.11045092 -0.08600713 -0.05832916 0.04531546 -0.05098567
[3,] 0.02597254 -0.03470686 -0.11045704 0.12626635 0.09034445
[,111] [,112] [,113] [,114] [,115]
[1,] 0.120807193 0.1195999 0.18925950 -0.09271472 -0.057085268
[2,] -0.001811178 -0.1268563 -0.05092565 -0.05587747 0.096366778
[3,] 0.097552113 -0.2609514 0.02977949 0.08170151 -0.006335007
[,116] [,117] [,118] [,119] [,120]
[1,] 0.11585514 -0.05049544 0.07540878 0.01785059 0.06430135
[2,] 0.02522018 0.07276074 0.10370429 -0.07917025 0.01869858
[3,] -0.05168045 0.04032857 0.19675742 -0.01150821 -0.01968286
[,121] [,122] [,123] [,124] [,125]
[1,] -0.04298311 0.04079489 -0.06041414 -0.011750890 -0.04550166
[2,] -0.05321378 -0.04124171 0.06694493 0.070510812 -0.21030827
[3,] -0.03093176 0.07614435 0.02510202 -0.008475666 -0.02347328
[,126] [,127] [,128] [,129] [,130]
[1,] 0.11097955 -0.24637091 0.046722800 -0.048847396 0.073720053
[2,] -0.10665352 -0.07501517 0.007717835 0.009107843 0.001662996
[3,] -0.05122698 0.01678034 0.023123045 0.031012105 0.063838013
[,131] [,132] [,133] [,134] [,135]
[1,] -0.13415056 -0.4292295 -0.02677542 0.14952262 -0.06541855
[2,] -0.03282406 -0.5320446 0.02072983 0.02825750 -0.02982503
[3,] -0.01259000 -0.5687474 -0.15318406 0.07306065 0.05096757
[,136] [,137] [,138] [,139] [,140]
[1,] 0.08021230 -0.09341189 -0.02671690 -0.15176196 0.02962985
[2,] -0.07013462 0.01992375 -0.06950717 -0.04408696 -0.09377313
[3,] -0.09520675 0.08959299 -0.04694959 -0.05613213 -0.10142585
[,141] [,142] [,143] [,144] [,145]
[1,] 0.16161388 0.07141577 0.06372322 0.005867817 -0.002618913
[2,] -0.01699820 -0.10967018 -0.04513898 0.081730612 0.294857025
[3,] 0.01110352 -0.12602286 0.01570023 -0.051091015 0.124610789
[,146] [,147] [,148] [,149] [,150]
[1,] -0.01872567 -0.04991600 -0.027256506 0.05930051 0.03952531
[2,] 0.09415734 0.01551705 -0.115617387 0.06616315 0.12677199
[3,] 0.25578880 0.02818135 -0.007225338 0.01288412 0.15643610
[,151] [,152] [,153] [,154] [,155]
[1,] 0.0230126 0.04690588 -0.04385430 0.025889043 0.05686368
[2,] 0.1484294 -0.05647697 -0.05922592 0.063226916 -0.02238526
[3,] 0.1842019 -0.11539790 -0.09148663 -0.006457172 0.01688721
[,156] [,157] [,158] [,159] [,160]
[1,] 0.1612850 0.02808929 0.07576993 -0.03871185 0.27184317
[2,] 0.3360443 0.06559707 0.36423922 -0.05806160 0.11002246
[3,] 0.3965186 -0.03016575 0.31495151 0.15312929 0.03696651
[,161] [,162] [,163] [,164] [,165]
[1,] 0.29307944 -0.08241996 -0.01799023 -0.11790153 -0.025170870
[2,] 0.09761115 0.05626684 0.03946232 0.03259929 -0.039699692
[3,] 0.17220785 -0.04270339 -0.02529519 -0.03280073 -0.007628142
[,166] [,167] [,168] [,169] [,170]
[1,] -0.04706457 -0.03228906 0.01486580 0.03410897 0.08997094
[2,] -0.02353669 -0.12128777 0.05145064 0.01461882 -0.01191414
[3,] -0.02756393 -0.11026121 0.03721116 -0.08949099 0.05856310
[,171] [,172] [,173] [,174] [,175]
[1,] -0.04632119 0.135610104 -0.02321601 -0.07550758 -0.16381302
[2,] -0.01514443 -0.038992934 -0.03243395 0.01624453 -0.04762726
[3,] -0.02180461 -0.006510535 0.01781113 0.02623862 -0.04048797
[,176] [,177] [,178] [,179] [,180]
[1,] -0.04189295 0.15148470 0.140410155 0.04326902 0.05095452
[2,] -0.11555878 0.08569998 -0.003490022 0.01828323 0.05416968
[3,] -0.16425563 0.17146082 0.068619400 0.13635762 0.09055427
[,181] [,182] [,183] [,184] [,185]
[1,] -0.01218278 0.047707740 -0.065614261 0.03087835 0.019091025
[2,] -0.05771073 0.008110725 0.029411763 -0.03026832 0.004953566
[3,] -0.15558219 -0.004117484 -0.008401374 -0.03395857 0.082504667
[,186] [,187] [,188] [,189] [,190]
[1,] 0.1010152 0.093787849 0.04519366 -0.149715766 0.02564542
[2,] 0.2768288 0.002896491 0.00288205 -0.002317041 0.20472515
[3,] 0.3093906 0.185895532 -0.05093533 0.102967449 0.16119444
[,191] [,192] [,193] [,194] [,195]
[1,] 0.08153410 -0.08363193 0.116248876 0.07510559 0.028269954
[2,] 0.06308736 -0.03121299 -0.009620543 -0.12536697 -0.009901358
[3,] 0.11336213 -0.01572398 -0.039867125 -0.06070736 0.071869873
[,196] [,197] [,198] [,199] [,200]
[1,] 0.04374793 0.0306067 -0.01423122 -0.0009407345 0.01116109
[2,] 0.03533378 -0.1049785 -0.04820460 -0.0315684490 -0.05145582
[3,] 0.01109681 -0.1666481 -0.05644229 0.0661051124 -0.07637785
[,201] [,202] [,203] [,204] [,205]
[1,] 0.09029138 -0.01473477 0.1183517 -0.06788336 0.002514364
[2,] 0.01361644 0.06719654 0.2151488 -0.06788865 0.020254625
[3,] 0.04770661 0.17415440 0.2358820 -0.01688100 0.109950788
[,206] [,207] [,208] [,209] [,210]
[1,] -0.10337599 -0.15819739 -0.10490708 -0.017575335 -0.06240090
[2,] 0.10523003 0.08059917 0.05202673 0.057690587 0.02943062
[3,] 0.02377997 -0.09855437 0.05364608 0.004027244 0.07190191
[,211] [,212] [,213] [,214] [,215]
[1,] -0.016532600 -0.07328504 0.08365475 0.34286380 -0.0963589
[2,] -0.008552969 -0.07551909 -0.12199020 0.25189748 -0.0565316
[3,] -0.119144619 0.05820637 -0.08432852 -0.05856914 0.0607432
[,216] [,217] [,218] [,219] [,220]
[1,] -0.17888170 0.03668439 -0.7004665 0.04737864 0.1626685
[2,] -0.02578335 -0.05152095 -0.3525909 -0.02983569 0.1501971
[3,] -0.03525455 -0.12300278 -0.2542538 0.16009760 0.1010381
[,221] [,222] [,223] [,224] [,225]
[1,] 0.16919723 -0.09332245 0.20004980 0.10661260 0.027264655
[2,] 0.01113881 -0.00366085 0.04691055 0.02603983 0.070807993
[3,] -0.02853836 0.07157905 -0.13754308 -0.03224405 0.009818178
[,226] [,227] [,228] [,229] [,230]
[1,] 0.02428964 0.06207667 -0.08166093 0.113831602 0.03132034
[2,] 0.07769687 0.07915758 -0.02231407 0.084806718 -0.15689461
[3,] 0.04967513 0.04366930 -0.13910171 -0.005473904 0.01076712
[,231] [,232] [,233] [,234] [,235]
[1,] -0.03456382 -0.07086996 -0.0664970949 0.079126269 0.1576967
[2,] -0.01303482 0.11235482 -0.0472119972 -0.007066698 0.1879414
[3,] -0.06117841 0.13229525 -0.0006693983 0.038082622 0.1642626
[,236] [,237] [,238] [,239] [,240]
[1,] -0.07242861 -0.060679540 0.007488072 -0.05117263 0.13693771
[2,] -0.18020511 -0.005515292 0.005323615 0.04557093 0.01427150
[3,] -0.20792490 -0.026204484 0.116029240 -0.00965337 -0.06306633
[,241] [,242] [,243] [,244] [,245]
[1,] -0.37703294 0.13546734 0.05247532 0.05501491 0.082340881
[2,] -0.06490818 0.05138187 0.06495947 0.05038793 0.007074311
[3,] -0.41937870 0.14372210 0.04367482 0.12992582 0.131404966
[,246] [,247] [,248] [,249] [,250]
[1,] -0.16188540 0.007680578 0.1909865 0.2358013 -0.11898704
[2,] 0.08033013 0.029313516 -0.1486792 0.2157641 0.05247597
[3,] -0.09704037 0.016597759 -0.2120424 0.2251720 -0.04899136
[,251] [,252] [,253] [,254] [,255]
[1,] -0.12922350 -0.3348031 -0.01761893 -0.1492761 -0.07322966
[2,] -0.05986992 -0.1188031 0.02589624 -0.1675690 0.01387598
[3,] -0.06133738 -0.1153320 0.13166033 -0.1098961 -0.05030071
[,256] [,257] [,258] [,259] [,260]
[1,] -0.09891027 -0.07905637 -0.01703418 -0.002923179 0.02023862
[2,] -0.05357978 -0.16829614 0.07828091 -0.223703027 0.27632055
[3,] -0.17185661 -0.08030650 0.01444841 -0.172713190 -0.07524167
[,261] [,262] [,263] [,264] [,265]
[1,] -0.006831818 0.04149275 0.19686872 -0.08984916 -0.1866602
[2,] -0.006285527 -0.09683912 -0.03744879 -0.05834809 -0.1240842
[3,] 0.012716721 0.03523421 -0.02654512 -0.14184952 -0.1396117
[,266] [,267] [,268] [,269] [,270]
[1,] 0.1602448 -0.05983455 -0.02839560 0.06783184 0.12312593
[2,] 0.0912225 -0.01839774 0.12244660 0.11336525 0.03489619
[3,] 0.0574608 -0.01124171 0.06315872 0.09125546 0.17926168
[,271] [,272] [,273] [,274] [,275]
[1,] -0.01121200 0.031648841 -0.02484243 0.07623786 -0.02644233
[2,] -0.07443111 0.008801795 -0.05950159 0.03754820 0.10479835
[3,] 0.01950239 -0.155382127 -0.19454606 0.11245190 0.02365979
[,276] [,277] [,278] [,279] [,280]
[1,] 0.14516488 0.01943621 -0.01519107 -0.01187081 -0.045566306
[2,] -0.07791726 0.25741455 0.05710046 -0.11898427 0.033412673
[3,] -0.07167783 0.06323096 0.05420353 -0.09452247 0.005256354
[,281] [,282] [,283] [,284] [,285]
[1,] 0.035979938 0.03678068 -0.11209080 -0.139278978 0.04726018
[2,] 0.008121938 0.01946798 -0.04401416 -0.004070202 0.11919580
[3,] 0.105893590 -0.08386994 0.18485342 -0.035839822 0.15128759
[,286] [,287] [,288] [,289] [,290]
[1,] -0.02799588 0.05072744 0.004907768 0.07601693 0.05490066
[2,] 0.01514776 -0.29562968 0.102084860 0.02824203 0.01639785
[3,] -0.05246643 -0.30615622 0.019979175 0.07344486 -0.04757974
[,291] [,292] [,293] [,294] [,295]
[1,] 0.09618767 0.151678517 -0.1004529 -0.05030722 -0.116703518
[2,] 0.04637577 0.105601251 -0.1033393 0.02358369 0.032865740
[3,] 0.08255721 0.003930302 -0.1791163 -0.02273582 0.008632692
[,296] [,297] [,298] [,299] [,300]
[1,] -0.15197571 0.06356946 -0.06262263 0.05438710 -0.05219115
[2,] -0.01940111 0.15565746 -0.02635029 0.07598012 0.16030227
[3,] -0.00429053 0.17145985 0.02258285 -0.01364348 0.22514419
[,301] [,302] [,303] [,304] [,305]
[1,] 0.2050680 0.12845989 0.01921978 0.04048699 -0.02587013
[2,] 0.1675498 0.03746923 0.05011429 0.07070537 -0.04895550
[3,] 0.1897785 0.02442981 -0.05904791 -0.02809922 -0.05312953
[,306] [,307] [,308] [,309] [,310]
[1,] -0.06091958 0.22622851 -0.02583806 -0.06351952 -0.001065356
[2,] -0.05661405 -0.01088095 -0.09921473 -0.07185391 0.018533990
[3,] -0.10915315 0.04063140 -0.02099844 -0.16146088 0.019671457
[,311] [,312] [,313] [,314] [,315]
[1,] -0.032305688 -0.01437410 -0.053030983 0.02671601 0.162066981
[2,] 0.008852237 -0.05506039 -0.041147631 0.19298290 -0.001432929
[3,] 0.015376883 0.01902910 0.006153993 0.14795077 0.060603369
[,316] [,317] [,318] [,319] [,320]
[1,] 0.01248342 0.06690809 -0.01680008 0.03164658 -0.01084370
[2,] 0.04505249 0.16234794 -0.07274230 0.06346707 -0.03178494
[3,] 0.12266167 0.14545971 0.04753947 0.06366099 0.05045570
[,321] [,322] [,323] [,324] [,325]
[1,] 0.07335888 -0.007874054 -0.016082630 -0.05392395 -0.06698276
[2,] 0.03584130 -0.144745380 -0.001119758 0.03509476 -0.14086261
[3,] -0.07533805 -0.114872098 -0.048632365 0.10942306 -0.05854078
[,326] [,327] [,328] [,329] [,330]
[1,] -0.02696791 -0.017976213 0.025982780 0.036848333 0.01237879
[2,] -0.08170927 0.134990618 -0.008862588 -0.003909879 0.06711595
[3,] 0.06490751 -0.005110458 0.154482007 0.064730100 0.08394097
[,331] [,332] [,333] [,334] [,335]
[1,] -0.7021178 0.5374565 0.19869882 0.08592588 0.003259264
[2,] -0.1397800 0.7935132 0.06652986 0.18187265 0.019942252
[3,] 0.6625274 0.6826792 0.03761757 0.13857222 -0.048566770
[,336] [,337] [,338] [,339] [,340]
[1,] -0.017559689 0.02492253 0.1249315 0.1226960 0.11163367
[2,] -0.005461998 0.03129506 0.1135423 0.0777054 0.03971887
[3,] -0.087679729 -0.03037414 0.1313429 0.2094652 0.15734860
[,341] [,342] [,343] [,344] [,345]
[1,] -0.10634105 -0.10901737 -0.06947979 0.05403144 -0.03136061
[2,] -0.03392104 -0.16822711 -0.16724649 0.06844141 0.04961351
[3,] -0.04125428 -0.09978348 -0.26348612 -0.04369469 0.10635111
[,346] [,347] [,348] [,349] [,350]
[1,] 0.0352215320 0.02250233 -0.14609206 0.02603752 0.0008976497
[2,] -0.0002137561 0.10198606 -0.16922621 -0.09600603 -0.1366553754
[3,] 0.0350311548 0.03004424 -0.05039074 0.06706302 0.0474682488
[,351] [,352] [,353] [,354] [,355]
[1,] -0.08492935 0.05261917 -0.002712078 -0.04173631 -0.08766926
[2,] -0.08518022 -0.09437098 0.089835979 -0.14466380 -0.05234888
[3,] -0.12240537 -0.04706511 0.197074294 -0.19491069 -0.08034088
[,356] [,357] [,358] [,359] [,360]
[1,] -0.01748293 0.08140319 -0.009076188 0.03891879 -0.07069510
[2,] 0.06296342 0.15020922 -0.024204466 -0.01938068 0.26828581
[3,] -0.04289609 0.08904836 0.036470607 -0.06100410 0.03539129
[,361] [,362] [,363] [,364] [,365]
[1,] 0.04525856 0.3758443 -0.02190541 0.162575215 0.005307974
[2,] 0.09426238 0.1260188 -0.07778172 0.002552769 0.054705024
[3,] 0.15059383 0.1224859 0.02159095 0.076193169 -0.103104755
[,366] [,367] [,368] [,369] [,370]
[1,] -0.01882286 -0.04616634 0.129491597 0.05433006 0.06411678
[2,] 0.04845531 0.09284367 0.110095747 -0.04976790 0.08954338
[3,] 0.13817395 0.10027109 0.005097982 -0.05057735 0.07692035
[,371] [,372] [,373] [,374] [,375]
[1,] 0.07350555 -0.09912018 0.034260299 -0.20898157 -0.13316488
[2,] 0.11582971 0.04861606 -0.006673804 -0.07216717 -0.04917652
[3,] 0.07229467 0.08957379 -0.070721515 -0.19933733 0.01460028
[,376] [,377] [,378] [,379] [,380]
[1,] 0.07324538 0.06339715 0.008160661 0.02553285 0.08604325
[2,] -0.02821313 -0.04864740 0.126741901 -0.04291559 0.11151189
[3,] 0.03416084 0.09956368 0.033908106 0.15106946 0.04633017
[,381] [,382] [,383] [,384] [,385]
[1,] 0.01628662 -0.03175199 -0.04446435 0.03977022 0.00684654
[2,] 0.01081612 0.06446750 -0.06379179 0.07895180 0.21498598
[3,] -0.02309628 0.15620320 -0.16393524 -0.02805457 0.10082961
[,386] [,387] [,388] [,389] [,390]
[1,] -0.0878603 -0.02482706 0.0805845782 0.26570842 0.002137563
[2,] -0.1599482 0.05167207 -0.0001966804 -0.03986673 -0.032002259
[3,] -0.1875746 -0.06778778 0.0429068431 -0.01857018 0.001538424
[,391] [,392] [,393] [,394] [,395]
[1,] -0.008382283 0.04031271 0.1503319 -0.15207227 0.016287033
[2,] -0.099398069 0.08796118 -0.0818783 0.01025959 0.039604645
[3,] 0.005648589 0.01951103 -0.1348186 0.03933498 0.005619545
[,396] [,397] [,398] [,399] [,400]
[1,] 0.05844205 0.04118289 -0.17063127 0.11593033 0.003098754
[2,] -0.01318270 0.10266561 -0.17282510 0.13746029 -0.063525043
[3,] -0.05150577 0.08933778 0.06263008 -0.04378749 -0.056211594
[,401] [,402] [,403] [,404] [,405]
[1,] 0.05415037 0.011254997 -0.08021654 -0.09940901 0.01778377
[2,] 0.11264771 0.035782840 -0.01895163 0.09955842 -0.05323046
[3,] 0.03951793 0.004913725 -0.03601250 0.09817193 -0.03813793
[,406] [,407] [,408] [,409] [,410]
[1,] 0.11230858 -0.09613845 -0.01305507 0.12205683 -0.037554771
[2,] -0.02192646 -0.21035673 -0.03902277 -0.14837089 -0.102020487
[3,] 0.03404685 0.04706251 0.01461852 -0.01263856 0.008175315
[,411] [,412] [,413] [,414] [,415]
[1,] -0.04531926 0.03520882 0.11528349 0.05115390 -0.01917591
[2,] -0.04315428 0.08763956 0.01078005 0.05163160 -0.14459552
[3,] 0.01963619 -0.03415635 -0.05583279 -0.04368478 -0.07436517
[,416] [,417] [,418] [,419] [,420]
[1,] -0.014584796 0.003684893 -0.05642702 -0.1454906 -0.1043315
[2,] -0.101387501 0.009382152 -0.11377819 -0.2054397 -0.1259652
[3,] -0.003488383 0.001876917 -0.16105342 -0.1437402 -0.1187559
[,421] [,422] [,423] [,424] [,425]
[1,] -0.17035030 0.01960437 0.05055789 -0.18750297 0.1078800
[2,] -0.09877777 -0.03259879 -0.06047024 -0.04328201 0.1905506
[3,] -0.12347282 -0.05843275 0.02038978 -0.12298420 0.1448566
[,426] [,427] [,428] [,429] [,430]
[1,] -0.01809759 0.07016796 -0.02551789 -0.0282625 -0.126578495
[2,] 0.06140823 -0.01092621 0.05080711 -0.1517675 -0.095688693
[3,] 0.02115142 0.05863923 -0.03656304 -0.1759150 -0.003724739
[,431] [,432] [,433] [,434] [,435]
[1,] -0.132467195 0.02622927 -0.03123109 -0.03247021 -0.08306324
[2,] 0.006821066 0.10227088 -0.08569778 -0.03584000 -0.12596449
[3,] -0.044484649 -0.01938494 0.01647643 -0.07612883 -0.11722742
[,436] [,437] [,438] [,439] [,440]
[1,] 0.05341662 0.008125714 0.01058675 0.003382702 -0.04252245
[2,] -0.03659999 -0.019274060 -0.02988921 -0.003417473 -0.07552858
[3,] -0.13190494 -0.101536736 -0.01074645 0.069811776 -0.12404119
[,441] [,442] [,443] [,444] [,445]
[1,] -0.07372800 -0.05849045 0.03524964 0.16877052 0.068114609
[2,] 0.08032336 0.01231460 0.06118907 -0.01793814 0.005942287
[3,] 0.06018349 0.02405287 0.12663981 -0.21619299 -0.003959647
[,446] [,447] [,448] [,449] [,450]
[1,] 0.07226302 -0.28510937 0.02432721 -0.002935223 0.12678717
[2,] -0.04607016 0.03129927 0.04820821 -0.023311311 0.04368496
[3,] -0.02281588 -0.16155379 0.11851458 0.048239492 0.04805805
[,451] [,452] [,453] [,454] [,455]
[1,] 0.1290212 0.045280058 0.009119998 -1.274157 0.08619729
[2,] 0.0715922 -0.005440829 -0.144796416 -1.462837 0.01355328
[3,] -0.1276753 0.029364327 -0.193132773 -1.059171 -0.05841826
[,456] [,457] [,458] [,459] [,460]
[1,] -0.02242112 0.12967354 -0.01173547 -0.03486820 0.1541892
[2,] -0.01034332 0.05542339 0.10062410 -0.04629513 0.1058829
[3,] 0.07782142 0.05496720 0.05659538 -0.03782411 0.1209047
[,461] [,462] [,463] [,464] [,465]
[1,] -0.02452869 -0.04038483 0.06677143 -0.015628178 0.06511339
[2,] 0.01132475 -0.08882064 0.01159206 0.001231097 0.06531174
[3,] -0.05360979 -0.05398347 0.01270098 -0.074746877 0.01321395
[,466] [,467] [,468] [,469] [,470]
[1,] -0.1577305 0.03123928 0.070899189 -0.03319991 0.03282479
[2,] -0.1554452 0.01563417 -0.001428645 0.02413461 0.03101723
[3,] -0.1477797 0.02752027 0.007906511 0.10748497 -0.00635145
[,471] [,472] [,473] [,474] [,475]
[1,] 0.16071421 -0.125148043 -0.100893088 -0.1231603 0.14092636
[2,] 0.17233622 -0.008775132 0.053332336 -0.2380183 0.12693952
[3,] 0.08292822 0.026071273 0.002210962 -0.1546290 0.04061038
[,476] [,477] [,478] [,479] [,480]
[1,] -0.03535345 0.13054915 0.15377441 -0.01675398 0.08626701
[2,] -0.04771874 0.07086749 0.10664982 -0.10120071 0.06549369
[3,] 0.02360129 0.03611998 0.02511051 0.10376409 0.02557622
[,481] [,482] [,483] [,484] [,485]
[1,] 0.05674988 0.001078123 0.04609403 -0.026389971 -0.001271373
[2,] 0.02827371 -0.029098878 0.14548145 -0.004448816 0.029100453
[3,] 0.04148384 -0.008389830 0.01104456 0.070395663 0.001577110
[,486] [,487] [,488] [,489] [,490]
[1,] 0.03562701 0.049074814 -0.0618827790 0.20455712 -0.04610657
[2,] 0.04760998 0.005309679 0.0760122985 0.05616186 -0.04608857
[3,] -0.07649758 0.091375560 0.0004809797 0.19519871 -0.03994152
[,491] [,492] [,493] [,494] [,495]
[1,] 0.07703701 0.007839035 0.10319084 0.03121312 0.1747248
[2,] 0.18174568 -0.029557465 0.09673726 0.11808877 0.1730784
[3,] 0.04589190 -0.154339537 0.18160686 0.08215430 0.1830094
[,496] [,497] [,498] [,499] [,500]
[1,] 0.04601399 -0.3952856 0.13922954 0.02999381 0.053702738
[2,] 0.05933195 -0.2772395 -0.01966263 0.33181602 -0.004030934
[3,] 0.10112993 -0.3435352 -0.02424987 0.25223950 0.046554431
[,501] [,502] [,503] [,504] [,505]
[1,] -0.02336188 -0.01022422 0.13448614 -0.01043796 0.05471098
[2,] -0.04218457 0.05461446 -0.04669698 -0.02909032 0.03523045
[3,] -0.05676673 0.17867416 0.07421271 0.05624302 -0.01802966
[,506] [,507] [,508] [,509] [,510]
[1,] 0.24928488 -0.06591306 -0.05561115 0.0006714305 0.054474905
[2,] 0.11431139 -0.07981958 -0.02691508 0.0866740122 0.005401139
[3,] -0.00323073 -0.05142399 -0.02943678 0.2296749055 0.023786074
[,511] [,512] [,513] [,514] [,515]
[1,] 0.002875101 -0.05484245 0.122998923 -0.03010709 -0.030595267
[2,] 0.053738769 0.11779324 0.007506833 0.03718942 0.122838140
[3,] -0.055321712 -0.02580264 0.081575297 0.02921003 0.007531753
[,516] [,517] [,518] [,519] [,520]
[1,] -0.12877816 -0.099791571 0.032153402 -0.01484757 0.01290180
[2,] 0.03527739 -0.092365213 0.043330155 -0.18486373 0.00277519
[3,] 0.09122708 -0.001451677 -0.001876002 -0.10912811 0.02595762
[,521] [,522] [,523] [,524] [,525]
[1,] -0.013234006 0.07565649 -0.0802963227 0.09339714 -0.06817224
[2,] -0.005343141 0.02226268 -0.0694348067 -0.01199249 -0.05812830
[3,] -0.041063350 0.03402158 -0.0004286381 -0.10582599 -0.04330410
[,526] [,527] [,528] [,529] [,530]
[1,] 0.06233599 -0.058382995 -0.01924860 0.04489377 0.06559096
[2,] -0.03440321 0.007027936 0.09098544 0.12303372 -0.10185946
[3,] 0.00528050 -0.018891983 0.02801421 0.09198729 -0.10712181
[,531] [,532] [,533] [,534] [,535]
[1,] 0.14161345 -0.174752995 0.06227533 0.0662514269 -0.2177512
[2,] 0.07809762 0.121065632 0.17180447 -0.0007127949 -0.1000329
[3,] 0.26621985 -0.003991501 0.11837573 0.0913059711 -0.1121633
[,536] [,537] [,538] [,539] [,540]
[1,] 0.1329743713 0.203391671 0.005818313 -0.024657749 0.100481018
[2,] 0.0004924695 0.032354366 0.092214897 0.002023025 -0.009617069
[3,] 0.1128094494 -0.004464632 0.065579392 0.203502029 0.011754591
[,541] [,542] [,543] [,544] [,545]
[1,] 0.06165432 0.06411295 -0.01389637 0.004815212 0.09737331
[2,] -0.31385234 0.07329942 -0.03446046 -0.010144308 0.16229889
[3,] -0.15213887 0.10936663 0.12071300 0.045249429 0.14473276
[,546] [,547] [,548] [,549] [,550]
[1,] 0.10238507 -0.04129021 -0.10708246 0.10174325 0.20909365
[2,] 0.07931236 0.14736558 -0.09683255 0.06213352 0.04103754
[3,] 0.08468400 0.13924018 -0.16481984 0.10367008 -0.10729636
[,551] [,552] [,553] [,554] [,555]
[1,] 0.0624070317 -0.61854422 0.04605782 0.14104550 0.0380168185
[2,] 0.0001775564 -0.08443949 0.01284193 0.04988941 -0.0070983134
[3,] -0.0473435894 -0.22047752 -0.10745245 0.03003494 -0.0004632226
[,556] [,557] [,558] [,559] [,560]
[1,] 0.081258409 -0.02223173 0.14613253 -0.008433553 0.003069871
[2,] -0.005587024 0.06710502 0.04002861 -0.115116470 -0.009286086
[3,] -0.016599791 0.07533991 0.01688313 -0.062957704 0.125670001
[,561] [,562] [,563] [,564] [,565]
[1,] -0.077496365 0.07959890 -0.044659276 0.09971232 0.19913223
[2,] -0.064988703 -0.26414856 0.012861216 0.04657340 -0.06462403
[3,] -0.005218811 0.05580022 -0.006904415 0.02663442 -0.01509167
[,566] [,567] [,568] [,569] [,570]
[1,] 0.114193216 -0.01769557 -0.05894598 0.0364887 0.06750645
[2,] 0.004687837 0.16266641 0.12134925 0.1508602 0.09792332
[3,] 0.026070904 0.06955954 0.09051076 0.2009770 0.06939902
[,571] [,572] [,573] [,574] [,575]
[1,] 0.1354541 0.03108129 -0.1254772 0.09168441 -0.03282591
[2,] 0.3937585 0.03401157 -0.1821007 -0.09378675 0.06853189
[3,] 0.2023968 -0.01192953 -0.1219219 0.04055867 0.08656785
[,576] [,577] [,578] [,579] [,580]
[1,] 0.02814430 0.02949820 0.08399966 0.002397518 -0.01157259
[2,] 0.03997610 0.04344099 0.05165761 -0.106884822 0.14118411
[3,] 0.04757469 0.08710670 0.12816823 -0.140741035 0.09758914
[,581] [,582] [,583] [,584] [,585]
[1,] -0.02753787 0.001775346 -0.03254072 0.07128654 0.01661594
[2,] 0.04450496 -0.064209178 -0.03106757 0.10829566 0.04823763
[3,] -0.01151269 0.017413810 0.01344837 0.16895512 0.06729863
[,586] [,587] [,588] [,589] [,590]
[1,] 0.1588211 -0.057526991 0.164113939 10.90037 0.006117357
[2,] 0.3630488 0.006175421 -0.022398140 11.46694 -0.026343763
[3,] 0.1494202 -0.146993756 -0.004960514 10.94750 0.002871577
[,591] [,592] [,593] [,594] [,595]
[1,] -0.03501413 0.09018756 0.09292749 0.06452341 0.09570796
[2,] -0.01308394 0.12172861 0.12719628 -0.04230946 0.01630062
[3,] 0.02746754 0.05904661 0.10432360 0.01748843 0.06194986
[,596] [,597] [,598] [,599] [,600]
[1,] -0.1245510 0.126792595 0.08956464 0.04358978 0.06552735
[2,] -0.1412971 0.068248354 0.10850821 -0.05155482 -0.03458041
[3,] -0.1030471 -0.008065663 0.16562979 -0.04389632 0.01321192
[,601] [,602] [,603] [,604] [,605]
[1,] 0.07334094 -0.14853717 -0.049167056 -0.025061384 -0.2480717
[2,] -0.10552808 -0.01617761 0.003674608 -0.039574828 -0.2337332
[3,] -0.05090923 -0.18733242 0.033544432 -0.002467056 -0.2309394
[,606] [,607] [,608] [,609] [,610]
[1,] 0.05167240 -0.06212182 0.03001972 -0.00619802 0.007160423
[2,] -0.01576734 0.06934274 0.05146546 0.10603949 -0.086451992
[3,] -0.03427850 -0.03544147 0.01841952 0.02314705 0.022775982
[,611] [,612] [,613] [,614] [,615]
[1,] -0.05672626 0.4887470 -0.09061193 0.02761512 0.1753153
[2,] -0.03457374 0.3132913 -0.06518495 0.07075723 0.1365166
[3,] 0.05754312 0.2122859 -0.16194762 0.09791545 0.1323497
[,616] [,617] [,618] [,619] [,620]
[1,] -0.073208764 -0.04377925 -0.2182470 0.086536877 -0.003400031
[2,] -0.040997539 -0.09075450 0.1293170 0.057046954 -0.022099968
[3,] 0.007723839 -0.08163230 0.1922674 -0.003527197 0.028169820
[,621] [,622] [,623] [,624] [,625]
[1,] -0.08855677 -0.039544635 0.2913368 0.1970724 0.13446003
[2,] -0.02975615 -0.002721837 0.1388374 0.1549672 -0.11485711
[3,] 0.02392290 -0.021772724 0.2180016 0.2168985 -0.08745814
[,626] [,627] [,628] [,629] [,630]
[1,] 0.025623247 0.02731249 0.09582750 0.165652469 0.09727748
[2,] 0.039845135 0.02735314 -0.03477661 0.004500133 -0.01256608
[3,] 0.003514442 0.01346861 0.08918107 0.032330044 -0.02128103
[,631] [,632] [,633] [,634] [,635]
[1,] 0.09574559 0.05824444 0.026450677 0.000007026363 0.1319726
[2,] 0.05082534 0.03188763 -0.044073578 0.045933425426 0.1515071
[3,] 0.05104866 0.02088815 -0.009409678 0.131420865655 0.1152052
[,636] [,637] [,638] [,639] [,640]
[1,] 0.11872996 0.06740426 -0.03295327 0.005091864 0.07032682
[2,] 0.06416409 0.03777796 0.02751510 0.095414653 -0.02035147
[3,] 0.17874897 -0.01981001 0.06767552 -0.010958292 0.01296261
[,641] [,642] [,643] [,644] [,645]
[1,] 0.06485382 0.10023060 -0.037353795 0.05855997 -0.04702448472
[2,] 0.05736234 0.02852193 0.005037601 0.02233046 0.03281811997
[3,] 0.18294042 0.28169319 0.029283861 0.04694387 0.00003481098
[,646] [,647] [,648] [,649] [,650]
[1,] 0.014599899 0.05295621 -0.2318424 -0.03862790 0.06915803
[2,] 0.002245907 -0.07289909 -0.2497116 -0.05421761 -0.05715271
[3,] 0.017213577 -0.04228573 -0.2032288 -0.02221883 0.09396903
[,651] [,652] [,653] [,654] [,655]
[1,] -0.008573882 0.13817659 0.11774102 0.007180711 0.01153503
[2,] 0.029099595 -0.07085797 -0.39698678 0.020039564 0.02389313
[3,] 0.048816685 0.11434027 0.09909724 0.011828766 0.06005841
[,656] [,657] [,658] [,659] [,660]
[1,] 0.16323003 -0.2821815 0.08282419 0.005385381 -0.080821373
[2,] 0.02120099 -0.1751777 0.01142891 -0.157813326 -0.007341859
[3,] 0.02138077 -0.2424365 0.07629174 -0.090664104 -0.010929093
[,661] [,662] [,663] [,664] [,665]
[1,] -0.05973516 -0.05402818 0.05043638 -0.053119019 -0.4382347
[2,] -0.03607860 0.09529447 0.12802537 -0.027307253 -0.1644347
[3,] -0.09080776 0.07575031 -0.03847428 -0.002830364 -0.2158440
[,666] [,667] [,668] [,669] [,670]
[1,] 0.127558082 -0.10169803 -0.06219704 -0.02747761 -0.01329563
[2,] -0.009646388 0.07948887 -0.23120938 -0.03643456 0.04320972
[3,] -0.021814600 -0.07878051 -0.23047507 0.03719737 0.03053882
[,671] [,672] [,673] [,674] [,675]
[1,] 0.01891686 -0.12061667 0.32487297 -0.005448162 0.006524894
[2,] -0.06934149 0.01744718 0.09623934 0.009026065 0.225343466
[3,] 0.14336102 0.07816807 -0.10652222 0.047874715 0.168353990
[,676] [,677] [,678] [,679] [,680]
[1,] 0.0451108 0.124926098 -0.06043627 0.003482156 0.13969089
[2,] 0.1218993 -0.030079177 -0.03301956 -0.047115240 0.10056076
[3,] 0.1264632 0.004649751 -0.02930072 0.053336959 0.02692399
[,681] [,682] [,683] [,684] [,685]
[1,] 0.04883071 0.006217855 0.105628 -0.03514947 0.1576692
[2,] 0.15232715 -0.054866929 0.146859 -0.07151469 0.1043521
[3,] 0.20380823 -0.171182945 0.048924 -0.06596526 -0.1094459
[,686] [,687] [,688] [,689] [,690]
[1,] -0.13343440 0.1150668 0.04277812 -0.1700584 -0.08152786
[2,] -0.02560283 0.1137769 -0.13468525 -0.0432230 0.09222019
[3,] -0.11482394 0.1435495 0.07105525 -0.0952179 -0.02150658
[,691] [,692] [,693] [,694] [,695]
[1,] 0.001460104 -0.02684199 0.159551024 0.01701519 -0.17243104
[2,] 0.076190174 0.04345487 0.122259133 0.04309671 -0.04582918
[3,] 0.076813765 0.07290456 -0.009004088 -0.02147820 -0.05113938
[,696] [,697] [,698] [,699] [,700]
[1,] 0.071569681 0.01079237 -0.06372253 0.03304843 -0.02441823
[2,] 0.061498780 -0.07271672 0.08297615 -0.09365286 -0.09535123
[3,] 0.008571736 0.06767070 0.04084178 0.01795634 0.01589342
[,701] [,702] [,703] [,704] [,705]
[1,] 0.051343724 0.017095907 0.08447219 0.01810732 0.03884545
[2,] 0.003084684 0.002061225 -0.04824588 -0.06848171 0.02627856
[3,] 0.019820197 -0.030093983 -0.02302835 -0.07308745 0.01341599
[,706] [,707] [,708] [,709] [,710]
[1,] 0.02292803 -0.02241533 -0.005699741 -0.14785856 0.06368943
[2,] 0.02831715 -0.02251743 0.113158464 -0.09536365 0.12465273
[3,] -0.02921605 -0.03969850 0.140876904 -0.07692195 0.03233643
[,711] [,712] [,713] [,714] [,715]
[1,] -0.03690190 0.093571730 -0.004948105 0.04304661 -0.01409842
[2,] -0.11779904 0.008528029 0.011699425 -0.04191633 0.13354866
[3,] -0.06761794 0.038781248 -0.031239903 -0.03373789 0.05055318
[,716] [,717] [,718] [,719] [,720]
[1,] -0.044394851 -0.01228573 0.004501287 0.03997793 0.11182661
[2,] -0.005906425 -0.07271305 0.073141493 -0.12115751 0.06879991
[3,] -0.086893030 -0.07782221 0.092925116 -0.09501198 0.03865187
[,721] [,722] [,723] [,724] [,725]
[1,] 0.16200098 -0.1963276 0.07506953 0.108284950 0.06242521
[2,] 0.07843442 -0.0272484 0.09158851 -0.045756642 -0.03038417
[3,] -0.16206633 -0.0492104 0.11310261 -0.001868449 -0.05736248
[,726] [,727] [,728] [,729] [,730]
[1,] 0.06534697 0.02324181 0.010514254 0.05806167 -0.002928009
[2,] 0.04052048 -0.23091494 -0.006549641 -0.03614023 -0.163491592
[3,] 0.04237001 -0.14198439 0.101073012 0.03866592 -0.154501140
[,731] [,732] [,733] [,734] [,735]
[1,] -0.07826689 -0.4306147 0.034221351 -0.06769373 0.023430072
[2,] 0.01333705 -0.4634736 0.003700569 -0.04821631 0.003874643
[3,] 0.07550879 -0.5461201 -0.050262697 -0.24380949 -0.072438218
[,736] [,737] [,738] [,739] [,740]
[1,] -0.1128417 -0.01578417 -0.099718347 -0.0455011204 -0.10483529
[2,] 0.2115270 0.04394335 0.007121652 0.0004530831 -0.08130268
[3,] 0.1422799 0.06445334 0.084635690 0.0257632788 -0.05460403
[,741] [,742] [,743] [,744] [,745]
[1,] 0.14446807 0.03796916 0.06176548 -0.02199821 0.007535934
[2,] 0.13209458 -0.11759082 0.11235521 0.03373785 -0.042034440
[3,] 0.09626281 -0.29080799 0.11512416 0.07427175 -0.164961562
[,746] [,747] [,748] [,749] [,750]
[1,] 0.1538259 -0.02231905 0.08385108 -0.09496891 -0.3132910
[2,] 0.1086871 0.02552897 -0.07375989 -0.10328012 -0.2329280
[3,] 0.1080883 0.02716528 -0.08429061 0.13082039 -0.1498961
[,751] [,752] [,753] [,754] [,755]
[1,] 0.13544297 -0.09229933 0.006370207 0.10247675 -0.01745539
[2,] 0.07169295 -0.11198869 0.277260184 0.07255528 0.01768901
[3,] 0.09499805 -0.12241976 0.367802501 0.06684625 0.10543489
[,756] [,757] [,758] [,759] [,760]
[1,] 0.05288321 0.09733097 0.06987759 -0.19151534 0.06136052
[2,] 0.02264082 -0.05838012 -0.06376933 -0.10843939 0.06910763
[3,] 0.22303495 -0.04375997 -0.15094276 -0.06138091 0.03490181
[,761] [,762] [,763] [,764] [,765]
[1,] -0.03410539 -0.01715597 0.08264564 0.16676839 0.1246100
[2,] -0.11565023 -0.06192952 0.02285620 0.02905226 0.3959301
[3,] 0.04694730 -0.07533912 -0.08235338 0.10327009 0.2405042
[,766] [,767] [,768]
[1,] 0.1230820 -0.01121444 0.03752019
[2,] 0.1823843 0.05410477 -0.13935684
[3,] 0.1092856 0.06907135 -0.121553393. Generating sentence embeddings for the CommonLit Readability dataset
In summary, NLP models may provide meaningful contextual numerical representations of words or sentences. These numerical representations can be used as input features for predictive models to predict a particular outcome. In our case, we can generate the embeddings for each reading passage. In the coming weeks, we will use them to predict the target score using various prediction algorithms.
First, we will check the length of the reading excerpts in the dataset.
Min. 1st Qu. Median Mean 3rd Qu. Max.
669.0 886.0 972.0 972.6 1059.0 1343.0 The number of characters ranges from 669 to 1343. In this case, I want to use a model that can handle long texts. For instance, RoBERTa would ignore any text after the first 512 characters in a reading excerpt, and we may lose some vital information regarding the outcome.
An alternative model to process longer texts is the Longformer model. The Hugging Face page for this model is https://huggingface.co/allenai/longformer-base-4096.
Let’s load this model as we did for RoBERTa.
model.name <- 'allenai/longformer-base-4096'
longformer <- st$models$Transformer(model.name)
pooling_model <- st$models$Pooling(longformer$get_word_embedding_dimension())
LFmodel <- st$SentenceTransformer(modules = list(longformer,pooling_model))This model can handle texts up to 4096 characters, and returns a vector of length 768.
LFmodel$get_max_seq_length()[1] 4096LFmodel$get_sentence_embedding_dimension()[1] 768Now, we can submit the reading excerpts from our dataset all at once, and get the sentence embeddings for each one. Since our dataset has 2834 observations, this should return a matrix with 2834 rows and 768 columns.
read.embeddings <- LFmodel$encode(readability$excerpt,
show_progress_bar = TRUE)# Check the embedding matrix
dim(read.embeddings)[1] 2834 768head(read.embeddings) [,1] [,2] [,3] [,4] [,5]
[1,] 0.06878642 0.02737294 0.0353682041 -0.17769572 0.17525391
[2,] 0.06200736 0.18268286 0.0024652195 -0.10744876 0.51925117
[3,] 0.02648670 0.09453232 0.0296205040 -0.06081667 0.25797406
[4,] 0.04218233 0.03943034 -0.0004737412 -0.22149815 0.16781905
[5,] 0.01741268 0.11062079 0.0012940745 -0.30953035 0.27908468
[6,] 0.03088607 -0.01201622 0.1024196073 -0.04266621 0.08677045
[,6] [,7] [,8] [,9] [,10]
[1,] -0.062003829 -0.009241561 0.18663073 -0.08267820 0.050396595
[2,] -0.009631317 0.021055585 0.10391098 -0.12528235 0.120555066
[3,] -0.026006516 0.010462754 0.07656582 -0.05405279 0.043316741
[4,] -0.130812421 -0.001381062 0.17187740 0.02726705 0.100796096
[5,] 0.201777592 -0.169042930 0.17893136 0.07310306 -0.053442664
[6,] -0.099492773 -0.007720584 -0.03680542 -0.08005710 -0.002916175
[,11] [,12] [,13] [,14] [,15]
[1,] -0.08924759 -0.12584847 0.07532627 -0.09043550 0.16977578
[2,] -0.12325408 -0.03490974 0.05919705 -0.07151967 0.06679756
[3,] -0.12445029 0.01071901 0.05318572 0.01152111 0.06358113
[4,] -0.01702231 -0.05677414 0.08501364 0.08951008 0.02121747
[5,] -0.08641744 -0.05077145 0.16863522 0.06391545 0.09241463
[6,] -0.10258079 -0.08562840 0.05569165 0.10128744 0.10752373
[,16] [,17] [,18] [,19] [,20]
[1,] 0.06627524 0.1254534 0.149795040 -0.09539226 -0.05386250
[2,] 0.06315146 0.1181628 -0.172043473 -0.10171498 0.08964073
[3,] 0.08248881 0.1091467 -0.076039344 -0.12442163 0.13084817
[4,] 0.21985857 0.2758147 0.066664048 -0.01095178 0.11738628
[5,] 0.06473929 0.1145013 0.026287500 -0.16021247 -0.03594755
[6,] 0.03598172 0.3445779 0.008862211 -0.03162296 0.06223473
[,21] [,22] [,23] [,24] [,25]
[1,] 0.019800426 0.05689066 -0.066817492 -0.01374022 -0.0005434537
[2,] -0.033529568 0.09369566 0.005841169 -0.12309865 -0.0396644436
[3,] -0.003348924 0.08551493 0.096154064 -0.04318059 -0.0134544317
[4,] 0.047499601 0.01420696 -0.059058707 -0.06542822 0.0618643127
[5,] 0.011399466 0.15386474 -0.157574072 0.12298665 -0.0167587493
[6,] 0.068682052 0.07682541 0.009790933 -0.09392697 0.0859657153
[,26] [,27] [,28] [,29] [,30]
[1,] -0.0398280062 0.06324669 0.1239742 0.05714065 -0.0784037
[2,] 0.0007338378 0.16816032 0.1769400 0.14561471 -0.1236172
[3,] 0.0233391654 0.09676986 0.1174871 0.16839454 -0.1228397
[4,] 0.0026793315 0.05301249 0.1669814 0.03192727 -0.2018328
[5,] 0.0843952000 0.24310870 0.2146871 0.04003200 -0.1260741
[6,] -0.0813994482 0.17552009 0.1065100 -0.05466254 -0.1454486
[,31] [,32] [,33] [,34] [,35]
[1,] -0.05841080 0.009110089 0.078652218 0.10221330 -0.10459986
[2,] -0.04242602 0.069912344 0.057975896 0.03614431 -0.18198293
[3,] -0.05578281 0.075226575 0.023002410 0.04269278 -0.05390055
[4,] -0.00404502 -0.018618550 0.001835824 0.06220116 -0.03155796
[5,] -0.20792694 -0.103156604 -0.026916955 0.07625656 0.05396373
[6,] -0.07710957 0.064506762 0.057588067 0.05781943 0.01271113
[,36] [,37] [,38] [,39] [,40]
[1,] 0.02391223 0.110306241 0.043328114 0.4521784 0.03735125
[2,] 0.04250664 -0.009082338 0.007062219 0.4343244 0.06531474
[3,] 0.01181644 0.005166513 0.011582398 0.3327737 0.09386559
[4,] -0.05737976 0.074416302 0.015505768 0.5607200 -0.03983847
[5,] -0.01515435 0.076285161 0.131026924 0.4974277 0.03435208
[6,] -0.01635659 0.006289245 0.023226904 0.3060058 0.05415952
[,41] [,42] [,43] [,44] [,45]
[1,] 0.01160207 -0.1441056 -0.06634481 0.013188138 -0.03034872
[2,] -0.09629171 -0.2475861 -0.06511805 0.029367110 -0.02183991
[3,] -0.08046697 -0.1241342 -0.07358038 0.041240882 -0.01687782
[4,] 0.02450111 -0.1278276 -0.04889721 -0.058667518 -0.04264880
[5,] -0.04384707 -0.1287246 -0.06949089 0.075815417 -0.04147740
[6,] -0.03843844 -0.2790852 -0.07422113 0.003265372 0.01405668
[,46] [,47] [,48] [,49] [,50]
[1,] 0.05563493 -0.12030786 0.17755996 -0.0009431239 0.02273739
[2,] -0.00349074 -0.25071853 0.11311000 0.0546880662 0.04223915
[3,] -0.03969015 -0.16227439 0.17778057 0.0135517670 -0.02265750
[4,] 0.01296046 -0.01586921 0.20198743 -0.0287195258 -0.02992338
[5,] 0.10140187 -0.21261519 -0.04230785 -0.0213186536 0.01532555
[6,] 0.05705843 -0.21435523 0.14221516 0.0081882812 0.06091512
[,51] [,52] [,53] [,54] [,55]
[1,] -0.055851076 0.045075454 0.0457919426 0.01860519 -0.04628744
[2,] 0.028229486 0.145248696 0.0022057290 0.02396804 -0.08741326
[3,] 0.013225293 0.138259456 0.0169651713 0.01428844 -0.09812585
[4,] 0.009362207 0.009168806 -0.0189137459 -0.07263523 -0.05096374
[5,] -0.054614712 0.016204031 0.0061255246 0.01164986 -0.12076854
[6,] -0.046974260 0.004813397 0.0006372099 -0.02829496 -0.07158546
[,56] [,57] [,58] [,59] [,60]
[1,] 0.11621416 0.19029057 -0.18323594 0.15596573 -0.16865835
[2,] 0.15194535 0.07216028 0.19703192 0.03920581 -0.05542378
[3,] 0.05171975 0.07081036 0.16018121 0.07730552 -0.12761781
[4,] 0.06082216 0.14776467 0.06345271 0.16414967 -0.11517348
[5,] 0.06762488 0.09770873 -0.06482673 0.05881982 -0.18440580
[6,] 0.18844305 0.15123229 0.03043088 0.07150017 -0.06692398
[,61] [,62] [,63] [,64] [,65]
[1,] -0.01584120 -0.30836877 -0.08627234 0.05220238 -0.073660202
[2,] 0.09358547 -0.12590311 -0.01988886 0.15112427 -0.057417575
[3,] 0.00353132 -0.02997617 -0.06488663 0.10850967 0.000176775
[4,] 0.07951759 0.01796308 -0.08190001 0.09804805 -0.032816716
[5,] 0.01957706 0.39047232 -0.16133040 0.22548598 -0.071758203
[6,] 0.05250159 -0.21743841 -0.03778880 0.11767841 -0.063424781
[,66] [,67] [,68] [,69] [,70]
[1,] -0.09121702 0.06205500 -0.00664423 0.044466395 0.10872079
[2,] -0.06620028 0.02835573 -0.07774094 0.025311865 0.10251271
[3,] -0.08376483 0.08219867 -0.15987641 0.002131245 0.04943869
[4,] -0.10609961 0.01014323 -0.20266037 0.042984761 0.04320575
[5,] -0.12487545 0.05126919 -0.21430783 -0.032729916 -0.02177408
[6,] -0.12166830 0.08317646 -0.05596460 0.031021968 0.12048520
[,71] [,72] [,73] [,74] [,75]
[1,] 0.05152616 -0.1286170 0.07124258 -0.13667069 0.0436399579
[2,] 0.11669674 -0.1081983 0.02155845 0.05324470 0.0256285314
[3,] 0.07750056 -0.1166162 0.03136687 0.08986921 -0.0002351542
[4,] 0.17135516 -0.1582801 0.02830557 -0.13921450 0.0152892377
[5,] 0.02453504 -0.2918184 0.01494434 -0.25516808 0.1191712022
[6,] 0.08055479 -0.1039434 0.03267877 0.08227553 -0.0112367412
[,76] [,77] [,78] [,79] [,80]
[1,] 0.09222718 -0.02197541 -5.946264 0.14185232 -0.002517788
[2,] 0.02680033 0.01777905 -5.769702 0.13710310 -0.039606657
[3,] 0.12901822 -0.04005376 -5.613939 0.19400115 -0.007314286
[4,] -0.03612557 0.07990569 -5.738643 0.11591304 -0.004460549
[5,] 0.00174457 -0.01451725 -6.881078 -0.05151975 -0.024183193
[6,] 0.03638640 -0.05377566 -6.141560 0.12704419 -0.014760924
[,81] [,82] [,83] [,84] [,85]
[1,] 0.041527856 0.09985719 1.121162 0.03830210 -0.063193858
[2,] -0.011150517 0.01501055 1.177877 0.01126669 -0.113686204
[3,] -0.007199855 0.02349413 1.150699 0.02726431 -0.095392525
[4,] 0.067316115 0.04642459 0.721678 -0.19776239 0.007204633
[5,] 0.026808724 0.08641411 1.250171 0.10575949 -0.082243785
[6,] -0.017409449 0.05579916 1.169361 0.05016227 -0.159839779
[,86] [,87] [,88] [,89] [,90]
[1,] -0.26729175 0.07502843 0.13967815 -0.02483355 0.007648359
[2,] -0.03492378 0.01044415 -0.01767602 0.02817056 -0.012143429
[3,] -0.19305614 0.04591532 0.11847871 0.06890325 0.066408977
[4,] -0.24397978 0.12207813 -0.01864471 -0.09496449 0.026372869
[5,] -0.08974808 0.03191085 0.03928379 0.08986512 0.036878455
[6,] -0.11673717 0.01388938 0.02112357 -0.02177202 0.040249281
[,91] [,92] [,93] [,94] [,95]
[1,] 0.085554458 0.07065610 -0.02443473 0.1472436 0.053917125
[2,] 0.005007802 0.07478565 0.01366426 0.1178765 0.090566173
[3,] -0.082261726 0.09630763 0.06820065 0.1347773 -0.003685075
[4,] 0.048539050 0.10452553 -0.03157165 0.1828313 0.032530654
[5,] -0.062374547 0.08127025 -0.05123742 0.3114559 0.083208121
[6,] 0.050125770 0.05533622 0.02127386 0.1706575 0.015914422
[,96] [,97] [,98] [,99] [,100]
[1,] 0.20212734 -0.116203837 0.23486662 -0.02284844 -0.04338972
[2,] 0.06854723 -0.059805643 0.74454349 0.03837124 0.01315809
[3,] 0.16587275 -0.040862981 0.60500520 0.01118777 -0.08465243
[4,] 0.21602593 -0.042178612 -0.03365597 -0.01383332 0.02952261
[5,] 0.10416410 -0.110708982 0.45391500 0.07056663 -0.02640560
[6,] 0.05282875 -0.001121965 0.56108010 0.01365058 -0.03908147
[,101] [,102] [,103] [,104] [,105]
[1,] 0.23872551 0.020933937 -0.2689151 0.15147276 -0.07147629
[2,] 0.15307951 -0.001722996 -0.2714304 0.03367482 -0.06458593
[3,] -0.04544293 -0.019447301 -0.1242545 0.19996431 -0.08332866
[4,] 0.09374914 -0.014098025 -0.2161348 0.16988960 -0.01689096
[5,] 0.46665555 0.075723723 -0.0992410 0.27997312 -0.11320364
[6,] 0.11137514 0.028680129 -0.2897870 0.04343583 -0.02774085
[,106] [,107] [,108] [,109] [,110]
[1,] -0.10091496 0.007719000 0.14613576 -0.06393286 0.08753217
[2,] -0.09945138 -0.130645871 -0.04965333 -0.03176723 0.06711566
[3,] -0.06551234 -0.116697073 0.05235539 -0.05145445 0.02444218
[4,] -0.17506407 0.036558561 0.01593233 -0.06472807 0.13053261
[5,] -0.06535351 -0.009498350 0.08395107 -0.05001440 0.04134391
[6,] -0.14649561 -0.008850493 0.06866036 -0.06751941 0.05398743
[,111] [,112] [,113] [,114] [,115]
[1,] 0.05948964 0.19408694 0.125716850 0.01159422 -0.07214574
[2,] 0.16257027 -0.05577020 0.044497672 -0.01349812 -0.07794671
[3,] 0.12493593 0.12674727 0.039884962 -0.02161937 -0.06567856
[4,] 0.02918692 0.12518449 0.006082227 0.06100188 -0.03282348
[5,] 0.09491364 -0.09426759 0.193379387 0.08677589 -0.13170332
[6,] 0.08426497 0.24839157 0.110648654 0.05496157 -0.13149224
[,116] [,117] [,118] [,119] [,120]
[1,] -0.04729865 -0.01458118 0.007416536 0.015140262 -0.01364085
[2,] 0.09857436 0.05374681 -0.029883321 -0.006696742 0.11462778
[3,] 0.08839864 -0.01325786 -0.036843956 0.028005935 -0.02517148
[4,] -0.03490236 0.01637201 -0.026882786 0.002716305 -0.02008895
[5,] 0.01232459 -0.03626100 0.051883530 -0.022906721 -0.08221104
[6,] -0.06458402 -0.02047255 -0.006263990 0.064767666 -0.14237389
[,121] [,122] [,123] [,124] [,125]
[1,] -0.029898381 0.13351487 0.03838781 0.12505446 0.277584553
[2,] 0.042145960 0.02854462 -0.03316170 -0.11165556 0.011946644
[3,] 0.052602947 0.06012842 -0.02576030 0.04977613 0.038049541
[4,] -0.032401364 0.11898023 0.11506625 0.04655128 0.011379799
[5,] 0.003823568 0.10826161 0.10774323 0.18962641 0.001085924
[6,] -0.001228545 0.12465001 0.02570309 0.06945270 0.124052927
[,126] [,127] [,128] [,129] [,130]
[1,] 0.16553748 -0.045734782 -0.02095836 -0.028291635 -0.031091623
[2,] 0.07167397 0.007441618 -0.15562278 -0.063137099 -0.016863035
[3,] 0.03975507 -0.010778110 -0.09103153 0.004879553 -0.007059486
[4,] 0.05562349 -0.062935844 0.02984938 -0.104437672 -0.044301443
[5,] 0.06157386 0.007056880 -0.01511185 -0.088381991 0.057884976
[6,] -0.03435799 -0.035998534 -0.05777951 -0.017548744 -0.040689226
[,131] [,132] [,133] [,134] [,135]
[1,] -0.068024397 -0.19685575 -0.057357501 -0.02150770 0.008344368
[2,] -0.127200842 -0.16465619 -0.030997569 -0.11230204 -0.059650008
[3,] -0.081564896 -0.02827076 0.002269247 -0.10395408 0.009244090
[4,] -0.107820205 0.22287221 -0.001476477 -0.06372286 0.015938897
[5,] -0.008750514 -0.12222122 -0.003253136 0.02914541 0.068772882
[6,] -0.103431627 -0.23775043 0.019290864 -0.02134318 -0.001622586
[,136] [,137] [,138] [,139] [,140]
[1,] -0.102784194 -0.13495629 0.0142317209 0.02313250 -0.02105902
[2,] -0.075864702 -0.03264857 0.0236496422 -0.06827071 0.10808191
[3,] 0.001411123 -0.03584372 -0.0004037199 -0.05033645 0.08863413
[4,] -0.063902400 -0.11118698 0.0589230135 0.06679199 0.02210390
[5,] -0.093556628 -0.22081396 0.0001657894 0.01393972 0.12405545
[6,] -0.020176252 -0.13743046 0.0230124258 0.03991869 0.04353123
[,141] [,142] [,143] [,144] [,145]
[1,] 0.088557333 0.040845133 -0.02909195 -0.024868179 -0.10013279
[2,] 0.009596834 0.078423120 -0.08343355 0.081874341 -0.13825487
[3,] 0.097992301 0.080675490 0.03624254 0.096607886 -0.05899038
[4,] 0.032477561 0.008287883 0.01552685 -0.093810037 -0.12003399
[5,] -0.045573782 -0.080180943 0.09660947 -0.003410187 -0.07613166
[6,] 0.052745692 0.069129847 -0.03849388 -0.013348532 0.05511277
[,146] [,147] [,148] [,149] [,150]
[1,] 0.01643182 0.040502507 -0.05167877 0.02774313 0.09360757
[2,] 0.04458265 -0.047292855 0.02723607 0.03013752 0.16895996
[3,] 0.01492312 0.006588188 -0.04234581 0.03453827 0.03027742
[4,] -0.06132180 0.020900434 -0.03471314 0.01671150 0.07657420
[5,] 0.08212277 -0.040125243 -0.06929307 -0.00432986 0.05462028
[6,] -0.04039430 0.055167176 -0.15788952 0.02860752 0.15503193
[,151] [,152] [,153] [,154] [,155]
[1,] -0.073861621 0.006610246 -0.07322597 0.004320241 0.079006694
[2,] -0.002897343 -0.032812975 -0.05331478 0.036128804 0.098519921
[3,] -0.061893009 -0.046659250 -0.06112369 0.034307890 -0.002737739
[4,] -0.004555190 -0.061745219 -0.05912172 0.062221162 -0.084972933
[5,] -0.023094578 -0.040132854 0.03313675 -0.009959953 0.055616483
[6,] -0.080483474 -0.080875732 -0.03731335 0.051242720 -0.007341798
[,156] [,157] [,158] [,159] [,160] [,161]
[1,] 0.1483632 0.008235849 0.1733116 -0.01954455 0.3793607 0.1087773
[2,] 0.2014366 0.067571804 0.3155718 -0.10236399 0.2850931 0.1659556
[3,] 0.1542511 0.003424891 0.2529557 0.03088392 0.2083622 0.1295714
[4,] 0.2362703 -0.027450442 0.2345958 -0.11995528 0.4174938 0.1058028
[5,] 0.1877714 0.063925140 0.2155312 0.08399600 0.5725406 0.1434436
[6,] 0.1657421 0.029531976 0.5287693 -0.01082900 0.2701406 0.1110887
[,162] [,163] [,164] [,165] [,166]
[1,] 0.02382109 0.03934348 -0.07816513 -0.063273966 0.08881398
[2,] 0.05152238 0.05214351 -0.12706640 -0.132280082 0.16892013
[3,] -0.01791148 0.02596789 -0.12161267 -0.018316647 0.05279658
[4,] -0.09078024 0.06221739 -0.04423966 0.020219367 0.07977139
[5,] 0.01971423 0.07503922 -0.16571607 -0.160742879 0.23236096
[6,] 0.07012735 0.01299729 -0.14214301 -0.008776547 0.07046251
[,167] [,168] [,169] [,170] [,171]
[1,] 0.11146063 -0.02742520 0.010782450 0.004686479 -0.04409403
[2,] -0.03822517 0.10706264 -0.017904045 0.010008985 0.04308533
[3,] 0.03960572 0.01006290 0.037345715 -0.020681502 0.02676369
[4,] 0.02204281 0.04992779 0.024536621 0.065638922 -0.06172321
[5,] -0.04216772 -0.05271583 0.015409810 0.044527601 -0.03895360
[6,] 0.15301870 0.09301525 -0.002569517 0.079733737 0.11045213
[,172] [,173] [,174] [,175] [,176]
[1,] -0.030827977 -0.016552867 -0.037396442 -0.110546499 0.02091328
[2,] -0.118163362 -0.101622179 0.041260589 0.065143712 -0.00664208
[3,] -0.133316681 -0.062520601 0.000882378 -0.001258559 -0.04469740
[4,] -0.108924128 -0.029740350 0.044388141 0.034460146 -0.03467989
[5,] 0.009975387 0.009619499 0.066007525 -0.016155105 0.03704870
[6,] -0.122878514 -0.031314857 0.041082900 -0.014921487 0.04582291
[,177] [,178] [,179] [,180] [,181]
[1,] 0.16406690 0.11637163 0.102757700 -0.065808818 -0.03085301
[2,] 0.23942780 0.12110980 0.192517295 -0.008136311 -0.11009263
[3,] 0.16348210 0.11496253 0.116396785 -0.053040501 -0.05610459
[4,] -0.01567582 0.13300121 0.143559024 -0.046972897 -0.06362554
[5,] 0.17504741 0.18193628 0.006118873 0.022498267 0.17850330
[6,] 0.21360956 0.02295497 0.114575908 -0.123433337 -0.03238666
[,182] [,183] [,184] [,185] [,186]
[1,] 0.047487181 0.08365419 -0.006170089 -0.0099381404 0.02653007
[2,] 0.047892727 0.05988264 -0.101161323 -0.0003986875 0.08727922
[3,] 0.022679541 0.05163966 0.004005735 0.0242591817 0.08526003
[4,] -0.005437774 0.05755933 -0.108031176 -0.0605965853 -0.06346862
[5,] 0.024581207 0.04812210 -0.115264393 -0.0225114767 0.05047017
[6,] 0.102973312 0.10902948 -0.045517776 0.0117747318 -0.03072424
[,187] [,188] [,189] [,190] [,191]
[1,] 0.15526831 0.07208288 -0.14248841 0.014994285 -0.011817173
[2,] 0.04445880 -0.02742394 -0.04661029 0.185127467 0.004467144
[3,] 0.07624952 -0.05811815 -0.06095228 0.085832350 0.029420679
[4,] 0.11060012 0.09253567 -0.11716639 0.112309471 -0.029765543
[5,] 0.14934652 0.03446966 -0.14601848 0.114642330 -0.031648837
[6,] 0.09348606 -0.02047507 -0.09198567 -0.005882796 0.044917762
[,192] [,193] [,194] [,195] [,196]
[1,] 0.2376663 0.06471327 0.2869302 0.006595411 -0.002131236
[2,] 0.1286241 0.01402647 0.2060701 0.057511937 0.080612928
[3,] 0.1429217 -0.03414715 0.2847818 0.063547119 0.014086470
[4,] 0.1777786 0.06618749 0.2010641 -0.062344369 0.014133361
[5,] 0.2387890 -0.03502944 0.4510851 0.118920438 0.100134738
[6,] 0.2079677 -0.00836664 0.2252501 0.042308558 -0.035618603
[,197] [,198] [,199] [,200] [,201]
[1,] 0.111284904 0.06065015 0.14765435 -0.09968079 0.05590762
[2,] -0.006094806 -0.04312481 0.07411973 -0.02219011 0.09446417
[3,] -0.026928667 0.03070987 0.10312929 -0.01123741 0.08575176
[4,] 0.064696468 -0.03691681 0.18689941 -0.02606682 -0.06948781
[5,] 0.116514213 -0.03425939 -0.10715778 -0.14326958 -0.04532622
[6,] 0.027877506 0.02917253 0.02128681 -0.02145256 0.09128784
[,202] [,203] [,204] [,205] [,206]
[1,] 0.146735489 0.11358202 -0.08193325 0.25428578 0.065701984
[2,] 0.027812298 0.08971079 -0.02867646 0.00942719 -0.054258276
[3,] -0.046032969 0.02980055 0.01649122 0.17686845 -0.050942793
[4,] 0.123839982 0.02067737 -0.07756262 0.21948744 0.007775099
[5,] -0.008841063 -0.07333382 -0.08066885 0.35297471 0.064149112
[6,] -0.053674281 -0.09016324 0.03218077 -0.02127722 0.046199832
[,207] [,208] [,209] [,210] [,211]
[1,] 0.01931344 0.055372115 0.01453709 0.02544891 -0.073285304
[2,] 0.06116709 0.009637616 0.03871655 -0.01346140 0.003739743
[3,] 0.12515076 -0.015982902 0.04348699 0.02505557 -0.025655473
[4,] 0.19800356 0.078355394 -0.02394519 0.01757303 -0.092073761
[5,] 0.18612207 0.150131032 0.03098740 -0.03294157 -0.097650550
[6,] 0.09481613 0.032243874 0.01760928 0.12533936 -0.021152314
[,212] [,213] [,214] [,215] [,216]
[1,] 0.07963207 0.054734237 -0.01597461 -0.054342546 -0.0002604671
[2,] 0.17093231 0.108724132 0.22238894 0.014393425 0.0134764072
[3,] 0.15664001 0.028745873 0.18153188 -0.102613285 0.0280863140
[4,] 0.05071726 0.009211972 0.05590099 -0.109988436 -0.0181687865
[5,] 0.12925413 0.067303337 0.27411485 -0.153481498 0.0342940465
[6,] 0.14717685 0.034810364 0.18813257 0.009363505 0.0130624538
[,217] [,218] [,219] [,220] [,221]
[1,] -0.058852341 0.12951709 -0.11006151 0.13824514 0.072320662
[2,] 0.044101015 0.01253397 -0.14474536 0.04638780 0.053958572
[3,] 0.056321442 -0.05187616 -0.03446175 0.16116869 0.083157308
[4,] -0.007440881 -0.08260800 0.10185594 0.04197086 0.116478071
[5,] -0.066293940 -0.26113343 -0.01156739 0.31020588 0.092619948
[6,] 0.075965993 -0.09815512 -0.08419202 0.27215043 0.001470058
[,222] [,223] [,224] [,225] [,226]
[1,] 0.07041030 0.03555779 0.072285376 0.05357500 -0.07106956
[2,] -0.01374738 0.17003758 -0.019520387 0.03457224 -0.03713996
[3,] 0.04476531 0.13863727 0.004889852 0.10775344 -0.10282592
[4,] -0.02810579 0.01348006 0.009996367 -0.02153545 -0.11958762
[5,] -0.02968163 -0.01568093 0.022583006 -0.11505753 0.06802285
[6,] 0.04070271 0.14868467 0.062011078 0.05736085 -0.13058169
[,227] [,228] [,229] [,230] [,231]
[1,] 0.16905032 0.03836681 -0.09137645 0.09602909 0.04561829
[2,] 0.06799433 0.05174431 -0.10136008 -0.01144294 0.05436248
[3,] 0.10437881 0.01218759 -0.05382705 -0.04475870 0.02737739
[4,] 0.20471486 -0.01401014 -0.14690535 0.07012411 0.07716142
[5,] 0.13378915 -0.01853155 -0.16943839 0.16641875 0.03436823
[6,] 0.13722783 0.03344594 -0.04833374 0.03120663 0.04564085
[,232] [,233] [,234] [,235] [,236]
[1,] -0.04100875 -0.09729417 -0.015945243 0.2084298 -0.32908994
[2,] -0.09437405 -0.09850014 -0.015326987 0.1066173 0.06720883
[3,] -0.08152922 -0.04496773 -0.020547934 0.1454203 -0.18244785
[4,] 0.04185037 0.01151387 -0.006661795 0.1374446 -0.41618568
[5,] -0.01318259 -0.05339691 -0.204763591 0.1586502 -0.31462738
[6,] -0.02640618 -0.05233365 0.049708031 0.1770238 -0.44506806
[,237] [,238] [,239] [,240] [,241]
[1,] -0.057311643 0.05173610 0.12793347 0.0748575628 -0.4823146
[2,] -0.113685295 0.12084391 0.06927693 -0.0003902306 -0.6902798
[3,] -0.088810235 0.06109840 0.03226926 0.0239857566 -0.4093242
[4,] 0.004091115 0.13506255 0.08105611 0.0400430895 -0.5522546
[5,] -0.093278319 0.09151746 0.08942989 0.0366468728 -0.6477040
[6,] -0.049687769 0.08295970 0.03150887 -0.0254437830 -0.3423410
[,242] [,243] [,244] [,245] [,246]
[1,] 0.0491617545 0.08810919 0.16544563 -0.029332409 0.04919896
[2,] 0.0671593398 0.12259185 0.20401637 0.018133275 0.03448596
[3,] 0.0335012637 0.10995636 0.08732561 -0.021502355 0.03198661
[4,] 0.0002215922 0.12138499 0.14508900 -0.086681329 0.12600115
[5,] 0.0538666286 0.03495837 0.30469996 -0.012076542 -0.01498211
[6,] 0.0276439749 0.11181737 0.15175976 -0.001726018 0.13548543
[,247] [,248] [,249] [,250] [,251]
[1,] 0.04697078 -0.04890043 0.1589750 -0.03094804 0.02603056
[2,] 0.19406812 0.14153977 0.1780439 -0.07918438 0.01485757
[3,] 0.05676338 0.05711843 0.1806150 0.02305853 -0.02673498
[4,] -0.04791526 0.09965809 0.1092957 -0.04397365 -0.01028533
[5,] -0.01059569 0.19260283 0.2623497 0.08115722 -0.01139705
[6,] 0.04929274 0.11131403 0.1806237 -0.02468466 -0.02996133
[,252] [,253] [,254] [,255] [,256]
[1,] -0.1724897 -0.002401687 0.01534870 0.13890797 -0.11863050
[2,] -0.1395971 0.031402815 0.06491155 -0.02091154 -0.16273288
[3,] -0.1389630 0.088268481 -0.01522258 -0.01420320 -0.16057290
[4,] -0.1291551 0.046002023 0.05335227 0.03016902 -0.09637893
[5,] -0.1920401 -0.042774189 -0.08610818 0.23634340 -0.13199009
[6,] -0.1981733 0.067647107 0.09951241 0.02313998 -0.08580471
[,257] [,258] [,259] [,260] [,261]
[1,] -0.0225894023 0.002869749 0.0007577947 -0.1680808 -0.01088620
[2,] -0.0189757459 0.013451111 -0.1751664877 -0.3328351 0.05819667
[3,] -0.0008530638 -0.031288225 -0.1339446753 -0.2323560 0.02520966
[4,] -0.0292648710 0.020038901 -0.0299417879 -0.1354145 0.04481651
[5,] -0.0285401363 0.079823844 -0.0336319245 -0.2776764 0.01303334
[6,] 0.0409367606 0.002441470 -0.2192038000 -0.1395366 0.02692296
[,262] [,263] [,264] [,265] [,266]
[1,] 0.015875859 0.10763116 -0.05167066 0.03018143 0.042046655
[2,] 0.016516799 0.02993468 -0.07149611 0.04834108 0.030737203
[3,] -0.020461027 0.14536050 -0.03549042 0.11245230 0.044793285
[4,] 0.004487541 0.05348589 -0.09096584 0.01046701 -0.073750377
[5,] -0.015841294 0.12982632 -0.09173639 -0.16630651 0.018952580
[6,] -0.020832295 0.08133712 -0.02231704 0.01190614 0.007591155
[,267] [,268] [,269] [,270] [,271]
[1,] -0.011430854 -0.02523194 -0.008423136 -0.012671799 -0.0837400183
[2,] 0.004502268 -0.03668711 -0.017272692 0.024523588 -0.0125292251
[3,] -0.003664760 -0.01398616 -0.037800763 0.038294815 0.0008871728
[4,] -0.022474337 -0.06638593 -0.031185303 -0.075725012 0.0010475843
[5,] -0.021464296 -0.07377630 -0.083129086 -0.036009334 -0.0625632778
[6,] -0.081773162 0.02574211 -0.016636886 0.002660608 0.0052323635
[,272] [,273] [,274] [,275] [,276]
[1,] -0.05445842 -0.0093964469 0.007517941 -0.011246663 -0.050030861
[2,] -0.11006894 0.0164988823 -0.094942071 0.041801900 -0.018264698
[3,] -0.01204425 -0.0008054683 0.044470005 0.007643088 -0.007325893
[4,] -0.04889615 0.0439554788 -0.097014301 0.012413584 -0.069276668
[5,] -0.15815380 -0.0682735518 -0.078197189 -0.049895536 -0.007100256
[6,] -0.05562257 0.0194925591 -0.037227783 0.018591374 -0.016361907
[,277] [,278] [,279] [,280] [,281]
[1,] 0.002760567 0.11517621 -0.06390390 0.071153320 -0.007525825
[2,] -0.065950707 0.12664177 -0.19320154 0.056531884 0.081739336
[3,] -0.068363689 0.10404641 -0.09738331 0.024798499 0.032022521
[4,] 0.191381738 0.07087343 -0.22808014 0.007383201 0.047871239
[5,] -0.167920634 0.06478498 -0.02706838 0.105121240 0.050797608
[6,] -0.134912848 0.05239017 -0.25800148 -0.030304926 0.061357789
[,282] [,283] [,284] [,285] [,286]
[1,] -0.08069538 0.021202818 -0.09088831 0.003913802 0.17268385
[2,] -0.18115973 0.007516647 0.04322838 0.066528082 0.08921006
[3,] -0.05470851 -0.030388746 0.01764945 0.005210739 0.07403997
[4,] -0.03100875 0.030917926 -0.05289397 0.049072228 0.12345744
[5,] -0.14827476 -0.034416664 -0.12222683 0.077855960 -0.01282306
[6,] -0.06022647 -0.054439630 0.00454731 0.010294611 0.06895743
[,287] [,288] [,289] [,290] [,291]
[1,] 0.03366879 -0.10051147 0.07276155 0.12489814 -0.029919706
[2,] -0.05449703 -0.13379160 0.05222794 0.09763101 -0.011916515
[3,] -0.03373038 -0.05401787 0.06726157 0.05924873 -0.003839437
[4,] -0.03131104 -0.12301756 0.14005129 0.12710060 -0.017647358
[5,] -0.64840341 -0.23175310 0.13674939 0.12690376 -0.084012493
[6,] 0.06048229 -0.13205385 0.02206899 0.06544769 -0.033752106
[,292] [,293] [,294] [,295] [,296]
[1,] 0.1965406 -0.0471164025 -0.09477758 -0.09592266 -0.14934851
[2,] 0.1406389 -0.1141664833 -0.11793546 -0.03406483 0.03635797
[3,] 0.2234888 -0.0002842388 -0.14569619 -0.10272630 -0.06068196
[4,] 0.1935525 0.0183725003 -0.07485901 -0.10831285 -0.14020436
[5,] 0.1750222 -0.0604986213 -0.04264855 -0.07688938 -0.09810477
[6,] 0.1693811 -0.0750083998 -0.10084461 -0.08070657 -0.18682951
[,297] [,298] [,299] [,300] [,301]
[1,] 0.005727845 -0.12093994 -0.003552702 0.020256335 0.016346853
[2,] 0.015381114 -0.02306485 -0.015180913 0.009877626 0.141062707
[3,] 0.015630685 -0.14868614 -0.007421072 -0.047970403 0.209519491
[4,] -0.049769286 -0.13912010 0.035268210 -0.045016538 0.171082839
[5,] 0.060936205 -0.17971252 0.027693467 0.137620136 0.006965111
[6,] 0.020025980 -0.08880578 0.018619476 0.059553828 0.181092486
[,302] [,303] [,304] [,305] [,306]
[1,] -0.11119895 0.077715434 0.055607371 0.123822115 -0.059588451
[2,] -0.03967703 -0.057833292 -0.060716528 0.030593542 0.047125291
[3,] -0.01229836 -0.035303757 -0.023960592 0.009966978 0.012475309
[4,] -0.13119549 -0.068845138 0.002193379 0.147963077 -0.109287247
[5,] -0.11175846 -0.002594928 -0.062189352 0.033291709 -0.072154455
[6,] -0.03947608 0.094287872 0.019838080 0.029311704 -0.007268577
[,307] [,308] [,309] [,310] [,311]
[1,] 0.05673822 0.05476711 -0.20486258 0.07061189 -0.062737666
[2,] 0.15709876 -0.02061976 -0.16822445 0.01269852 -0.004345024
[3,] 0.11021169 0.05043468 -0.07344368 -0.05323145 0.003844622
[4,] 0.19097759 0.03540033 -0.14295101 0.02988683 -0.021163179
[5,] 0.25572175 0.02911083 -0.12724619 0.06165682 -0.003929416
[6,] -0.01906445 0.13942367 -0.13242154 0.07677628 -0.046496250
[,312] [,313] [,314] [,315] [,316]
[1,] -0.08939619 -0.062958047 0.002350205 -0.028255599 0.0001992079
[2,] -0.21793611 -0.065695688 0.139431939 -0.057130031 0.0188816339
[3,] -0.14733313 -0.054874431 0.075538740 0.003273665 0.0071602282
[4,] -0.13412905 -0.012387750 0.120887332 0.002740759 -0.0330684409
[5,] -0.28124347 -0.009996795 0.111794926 0.031146541 -0.1252306700
[6,] -0.05679907 -0.093764365 -0.010528004 0.028798489 0.0264520179
[,317] [,318] [,319] [,320] [,321]
[1,] 0.2366612 -0.11066158 0.10403828 -0.093767919 0.015524159
[2,] 0.1956885 -0.10604562 0.16890952 -0.016343875 -0.001231328
[3,] 0.1087591 0.02513982 0.08264175 -0.071640648 0.017064070
[4,] 0.2386470 -0.14696006 0.13099055 -0.006232007 -0.001926191
[5,] 0.2298327 0.05288503 0.11605821 -0.037210070 0.103908330
[6,] 0.2072268 -0.02443120 0.07308445 -0.073828861 0.048229817
[,322] [,323] [,324] [,325] [,326]
[1,] 0.015304311 0.06769788 0.0001059437 0.13685572 -0.007125911
[2,] -0.008312246 0.07099401 0.0118308347 0.11766487 -0.052791048
[3,] -0.018496867 0.02761492 0.0046130028 0.16656889 -0.009691294
[4,] -0.108083107 0.10613571 -0.0353088155 -0.03805166 -0.025139719
[5,] -0.039033186 0.16623124 0.0668120831 0.03538605 -0.161977589
[6,] -0.059934128 0.13409884 0.0132886814 0.06696119 -0.010411450
[,327] [,328] [,329] [,330] [,331]
[1,] -0.09181453 0.16432312 -0.009687589 0.17562778 0.07574756
[2,] -0.06574848 0.01219540 -0.081525952 0.09776805 -0.61099488
[3,] -0.22979331 -0.00453141 -0.068012930 0.08546595 -0.64116883
[4,] -0.08695555 0.03141475 -0.049017664 0.07748068 -0.32160136
[5,] -0.17806914 -0.10213739 -0.101243451 0.16242576 -0.14651221
[6,] -0.01661999 0.07961593 -0.058121491 0.11321305 0.18859792
[,332] [,333] [,334] [,335] [,336]
[1,] 1.193441 0.0129416380 -0.04349080 0.023731416 -0.01097963
[2,] 1.284796 -0.0026454674 -0.05538445 0.048212808 -0.02144463
[3,] 1.263941 -0.0068049454 -0.02919309 0.054390196 -0.03931105
[4,] 1.251522 0.0002867049 -0.12403233 -0.007573304 -0.04308565
[5,] 1.432551 0.0599770546 -0.14562739 0.028240087 -0.01404148
[6,] 1.122777 0.0230755098 -0.16138813 0.047617856 -0.04634143
[,337] [,338] [,339] [,340] [,341]
[1,] -0.0005624792 0.07864352 0.04369727 0.2572507 -0.13316961
[2,] -0.0054396740 0.05523947 0.15087622 0.1561821 -0.16100292
[3,] 0.0424030162 0.10528552 0.11152666 0.1685743 -0.11688816
[4,] 0.0157117005 0.06848166 0.05481624 0.1754922 -0.19357994
[5,] -0.0011950094 0.06173320 0.07855321 0.1942654 -0.14314735
[6,] 0.0254576858 0.10283647 0.07377444 0.1628036 -0.05531729
[,342] [,343] [,344] [,345] [,346]
[1,] 0.084040277 -0.20822357 -0.01748156 0.036807824 0.006929139
[2,] 0.022380980 -0.24127041 -0.01108753 0.003058314 -0.040675364
[3,] 0.028627515 -0.14913662 -0.02476752 0.031754505 -0.023920799
[4,] 0.064644255 -0.08234471 -0.10837119 0.067176044 0.017211705
[5,] 0.095448487 -0.23304875 0.01558274 0.068599999 0.039748468
[6,] -0.008355043 -0.17206128 -0.02875835 -0.000583343 0.013256798
[,347] [,348] [,349] [,350] [,351]
[1,] -0.005286428 -0.05701319 0.13193549 0.08130930 0.04443504
[2,] -0.086272962 -0.02544612 0.10772895 0.13471921 0.15701103
[3,] 0.002710936 -0.10538142 0.07507202 0.07743213 0.12704344
[4,] -0.040683534 -0.05692405 0.13225992 0.18849103 -0.02326316
[5,] 0.039327800 -0.01303095 0.11355264 0.07589500 0.13782470
[6,] -0.079469174 -0.02516594 0.06308875 0.05220953 0.07971393
[,352] [,353] [,354] [,355] [,356]
[1,] -0.02041185 0.024838975 0.15259443 0.03433982 0.01410498
[2,] -0.15240444 -0.043450933 0.08405434 0.05179580 -0.02859024
[3,] -0.13477083 -0.027553072 0.08378947 0.04356062 -0.05607921
[4,] 0.00702041 -0.009490191 0.10871423 0.01426539 0.13265060
[5,] 0.04278595 0.179218471 0.21891491 0.02857704 0.13487510
[6,] -0.01153280 0.004404217 0.07570871 0.07068371 0.11111432
[,357] [,358] [,359] [,360] [,361]
[1,] -0.0292523298 0.03229756 0.06580498815 -0.3292757 0.1424101
[2,] 0.0261140857 0.07876643 0.07768756896 -0.2670496 0.2002343
[3,] 0.0005733054 0.03968107 -0.03592544794 -0.2605197 0.1676459
[4,] -0.0405364856 0.05002245 0.05217316374 -0.1848912 0.1879823
[5,] 0.0207061786 0.03774624 0.11750797927 -0.6159015 0.2709713
[6,] -0.0419533104 -0.01498811 -0.00003440182 -0.1675033 0.1870018
[,362] [,363] [,364] [,365] [,366]
[1,] 0.0003190466 0.10675317 -0.111781068 -0.26239395 -0.05190451
[2,] 0.0764605403 0.06744294 -0.010644180 -0.08685648 -0.06909190
[3,] 0.0122582344 0.06609353 -0.046548788 -0.04289630 -0.16739215
[4,] -0.0306625608 0.13241743 -0.007170338 -0.22639199 -0.08798391
[5,] -0.0633786842 0.06781193 -0.142221734 -0.24863669 -0.08552787
[6,] 0.0074897874 0.13996646 -0.026384473 -0.11121219 -0.05444014
[,367] [,368] [,369] [,370] [,371]
[1,] -0.2834142 0.1727780 -0.07177187 -0.024423050 0.11998454
[2,] -0.2122738 0.1857841 -0.08979926 -0.061952963 0.18627794
[3,] -0.2145126 0.1474682 -0.06742267 0.003836003 0.16774292
[4,] -0.3423468 0.2046937 -0.09281652 -0.062675677 0.07005385
[5,] -0.4036809 0.1320605 -0.07927746 0.047409087 0.14555788
[6,] -0.2898973 0.1320122 -0.10214323 -0.049238041 0.14702497
[,372] [,373] [,374] [,375] [,376]
[1,] -0.041142341 -0.018378917 0.01463352 -0.08249739 0.071360566
[2,] 0.004512242 0.056799449 -0.10813290 -0.12739737 0.108280510
[3,] -0.006871527 0.012354914 -0.05375824 -0.09662658 0.045653116
[4,] 0.067509219 -0.007863864 -0.09351169 0.03765030 -0.020628667
[5,] 0.089546248 0.028547799 -0.16447680 -0.04109525 0.001788142
[6,] -0.043425713 0.015164633 -0.11218750 -0.05097958 0.068636134
[,377] [,378] [,379] [,380] [,381]
[1,] 0.12089308 -0.013052741 0.16159718 -0.033959396 -0.05752983
[2,] -0.01441357 0.005857999 -0.02121415 -0.036436468 -0.05078482
[3,] 0.02916666 0.013266120 0.13223200 -0.067180336 -0.04920297
[4,] 0.08411981 -0.018478211 0.22633652 -0.132887974 -0.00440924
[5,] -0.01408248 -0.024376320 0.23904698 -0.001653882 -0.07003044
[6,] 0.02938977 0.006751281 0.12645385 -0.053276427 -0.10031450
[,382] [,383] [,384] [,385] [,386]
[1,] -0.022969488 -0.080281503 0.06668742 0.10190790 0.129292399
[2,] 0.121824607 -0.015189585 0.08290621 0.06280330 0.016867727
[3,] 0.006504176 -0.002793557 0.08314306 0.12468025 -0.008007731
[4,] -0.073884942 -0.102000907 0.03791762 0.13350716 0.163697481
[5,] 0.017336383 -0.135498956 0.08327901 0.24546270 0.137031600
[6,] 0.013923938 -0.113184415 0.04481167 0.04153857 -0.015584327
[,387] [,388] [,389] [,390] [,391]
[1,] 0.04810674 -0.07212174 0.3981770 0.000651068 -0.01844281
[2,] 0.08981262 -0.05153822 0.2162744 -0.028560745 -0.05627009
[3,] 0.03696474 -0.01001888 0.1683803 -0.063800417 -0.06998126
[4,] 0.04972491 -0.02204287 0.4260711 -0.051906057 -0.01058496
[5,] 0.15990907 -0.04117636 0.5371452 -0.097876579 -0.09795716
[6,] -0.01717817 -0.02943450 0.2676919 -0.051112194 -0.09012391
[,392] [,393] [,394] [,395] [,396]
[1,] 0.09665750 -0.21984693 0.077912547 -0.0058517088 0.01657313
[2,] -0.03973968 -0.19702394 -0.096619479 -0.0071436288 -0.05720001
[3,] -0.01701060 -0.11564402 -0.038870413 0.0449757017 -0.04972860
[4,] 0.03982517 -0.18398654 -0.002435916 0.0043237559 -0.01682329
[5,] 0.06203847 -0.05672979 0.094466582 0.0115374159 0.02329841
[6,] 0.09998129 -0.06618091 0.092190057 0.0006072707 -0.01348944
[,397] [,398] [,399] [,400] [,401]
[1,] 0.029640796 -0.2341008 0.2731010 -0.031091580 -0.01752099
[2,] 0.008583851 0.1481631 0.2792898 -0.064082794 -0.07462133
[3,] 0.040935591 0.1765531 0.2668295 -0.038621537 -0.06084965
[4,] 0.081413433 -0.2189223 0.2725447 -0.195925117 -0.03351154
[5,] 0.186902285 0.1041174 0.2916219 -0.148684010 -0.07247491
[6,] 0.037978858 -0.2098601 0.2650369 -0.003034409 -0.08609407
[,402] [,403] [,404] [,405] [,406]
[1,] -0.055302404 -0.08445628 0.124047980 -0.07431474 0.033396285
[2,] 0.026117302 -0.06102932 0.003592577 0.07306582 -0.087093271
[3,] -0.026919138 -0.02823371 0.013763811 0.06260777 0.003319245
[4,] -0.084522232 0.01085360 0.148553595 0.14148732 0.085137658
[5,] 0.004054369 -0.05274140 0.276448041 -0.02868071 -0.083662651
[6,] 0.085933879 -0.04678488 0.110170588 0.11049432 -0.065488786
[,407] [,408] [,409] [,410] [,411]
[1,] -0.0833341256 -0.014363504 -0.08923447 0.18580405 0.0527944863
[2,] 0.0011571615 -0.042233806 -0.05868121 0.10632948 -0.0005507554
[3,] -0.0839891359 0.001657259 -0.11240651 0.09383041 0.0061236657
[4,] -0.0770618767 -0.014581834 -0.18196091 0.16608985 0.0234143566
[5,] -0.0693483502 -0.138323084 -0.20459747 0.23080853 0.0352744423
[6,] -0.0009951121 0.019755036 -0.15968242 0.11442276 -0.0185750797
[,412] [,413] [,414] [,415] [,416]
[1,] 0.07303324 0.10113084 -0.06256250 0.1384585 -0.09067871
[2,] 0.02094452 0.04001701 -0.03109857 0.1248479 -0.06825428
[3,] 0.03956146 0.01913995 -0.01180687 0.1212969 -0.06751077
[4,] 0.03233004 0.07872116 0.06508625 0.0848489 -0.03301696
[5,] 0.07095757 0.02153363 0.14255515 0.1556596 -0.03317551
[6,] 0.06180367 0.02782013 0.06218156 0.1112180 -0.04977389
[,417] [,418] [,419] [,420] [,421]
[1,] 0.019350978 0.01523919 -0.034700625 -0.15207638 -0.09571344
[2,] 0.015089027 -0.13927549 0.059285089 -0.07940488 -0.13693495
[3,] -0.001048695 -0.03808055 -0.063612774 -0.05192776 -0.18541250
[4,] 0.031780388 -0.08320169 0.066831119 0.02576646 -0.08961902
[5,] 0.039614756 -0.10220528 -0.120935448 -0.17789137 -0.10625569
[6,] 0.058109745 -0.01198777 -0.004356108 0.08624344 -0.10441324
[,422] [,423] [,424] [,425] [,426]
[1,] -0.02452135 0.14253086 -0.05657317 0.3280779 -0.050315730
[2,] -0.06415525 0.07602257 -0.06367315 0.1944746 -0.065398335
[3,] -0.06640281 0.02816646 -0.09902421 0.1656896 -0.024696238
[4,] -0.04900699 0.19998491 -0.10840013 0.3802281 0.003306185
[5,] -0.01606719 0.20564817 0.00140973 0.6608974 0.056467004
[6,] -0.03569328 0.09580938 -0.06109742 0.1208945 -0.076438911
[,427] [,428] [,429] [,430] [,431]
[1,] -0.057930082 -0.05862350 -0.095415689 -0.10481034 -0.06387607
[2,] 0.010639274 -0.12303247 -0.051223289 -0.09339171 -0.05981595
[3,] -0.001297983 -0.03304556 -0.122825339 -0.12358673 -0.06911961
[4,] -0.123188123 -0.16720073 0.003969586 -0.10472445 0.06382620
[5,] -0.115927018 -0.08907121 -0.051757324 -0.17229636 -0.06435966
[6,] -0.064655416 -0.06646870 -0.047626436 -0.13625301 0.03774286
[,432] [,433] [,434] [,435] [,436]
[1,] 0.13167702 -0.043118063 0.06146807 0.01869973 -0.035224576
[2,] 0.16845942 -0.192152798 0.13094904 0.03596283 0.033534888
[3,] 0.14747572 -0.076833479 0.13047643 0.02428866 0.014121264
[4,] 0.25472251 -0.007195167 0.15603444 -0.00596704 -0.059642036
[5,] 0.07380281 -0.071108758 0.15276530 0.05286176 -0.119509064
[6,] 0.11972743 -0.148522720 0.09822256 -0.08528683 -0.005617861
[,437] [,438] [,439] [,440] [,441]
[1,] 0.002619761 -0.08160212 0.08646131 -0.07696088 0.06323978
[2,] -0.009239418 -0.10202175 -0.02077171 -0.06891251 0.05190685
[3,] -0.009320967 -0.04484579 0.10739184 -0.02527408 -0.00380435
[4,] 0.054793835 -0.07226864 0.01493895 -0.08142722 0.07248068
[5,] -0.043097962 -0.18096198 -0.06011949 -0.18862140 0.21504816
[6,] 0.023491399 -0.01777480 0.07863464 -0.12527528 0.16570453
[,442] [,443] [,444] [,445] [,446]
[1,] 0.01898709 0.092833392 0.06426620 0.10507441 0.084170453
[2,] 0.05463684 0.003707611 -0.09394057 0.05733651 0.106665961
[3,] 0.04206577 0.029764373 0.01227091 0.08231951 0.069943115
[4,] 0.09810630 0.079904787 0.07489314 -0.01253995 -0.008394581
[5,] 0.06945176 0.109472521 0.04685316 0.04640696 0.102879412
[6,] 0.03247901 0.101068415 0.01057376 0.11562008 0.069222540
[,447] [,448] [,449] [,450] [,451]
[1,] -0.024374206 0.04312007 0.107861504 0.13711369 0.1291108
[2,] 0.001252827 0.08850355 0.049432795 0.06416221 0.1807139
[3,] -0.038332362 0.08287523 0.023291139 0.06984615 0.1361608
[4,] -0.021328092 0.12580599 0.139093950 0.06507008 0.1231573
[5,] -0.129619345 0.10041834 0.199645579 -0.01893841 0.1511120
[6,] -0.030451402 0.09080670 -0.002246229 0.09229445 0.1914775
[,452] [,453] [,454] [,455] [,456]
[1,] -0.06324755 -0.2063144 -1.571300 0.011344370 0.010410558
[2,] -0.08418371 -0.2678480 -2.114250 -0.065529682 -0.081989832
[3,] -0.04842710 -0.1767584 -2.138216 0.027580163 -0.015867468
[4,] 0.02564547 -0.1488806 -1.496716 -0.007744787 -0.008718793
[5,] -0.05997337 -0.4564939 -1.645690 0.049410906 0.040771157
[6,] -0.11389697 -0.2701066 -1.500608 -0.003843458 0.063257314
[,457] [,458] [,459] [,460] [,461]
[1,] 0.03868202 -0.05845854 -0.12579459 0.005873961 -0.04595002
[2,] 0.10147323 -0.04141930 -0.09119720 0.114982814 -0.09992974
[3,] 0.04151445 -0.04142060 -0.09097617 0.015678143 -0.05815847
[4,] 0.03656706 -0.14261545 -0.21980679 0.045785569 -0.01823764
[5,] 0.11710306 -0.07848915 -0.34025028 0.061278366 0.03995755
[6,] 0.01473739 -0.09901690 -0.18111326 0.036432479 -0.08962186
[,462] [,463] [,464] [,465] [,466]
[1,] -0.022218920 -0.009022172 0.064793751 -0.01880163 -0.09919238
[2,] -0.148305222 -0.019372806 -0.015265632 0.08394215 -0.10314022
[3,] -0.073457286 0.009041996 -0.009008986 0.06632591 -0.02867668
[4,] 0.006836804 -0.142976373 0.013609613 0.10924794 -0.05234744
[5,] -0.121134020 -0.058553871 -0.002999091 0.01065715 -0.04240579
[6,] -0.073510975 -0.042291988 0.015074087 0.04148116 -0.08730940
[,467] [,468] [,469] [,470] [,471]
[1,] -0.1562882 0.09386369 0.01467662 0.0904685780 -0.14649619
[2,] -0.1320574 0.11428429 -0.06193297 0.0262522604 -0.01595671
[3,] -0.1121669 0.13802610 0.14548612 0.0356551185 0.04380416
[4,] -0.1064183 0.10055429 0.02231788 0.0873961374 -0.01238519
[5,] -0.1398273 0.35697773 -0.11256426 0.0611174740 -0.14872175
[6,] -0.2030301 0.02190426 0.00917128 -0.0002893528 -0.02008463
[,472] [,473] [,474] [,475] [,476]
[1,] 0.06360921 0.002835296 -0.14112200 0.01089384 -0.09374716
[2,] -0.09267101 -0.011794514 -0.09564537 0.09496267 -0.09849050
[3,] -0.06956573 -0.032383204 -0.06577902 0.05314546 -0.08813422
[4,] 0.06355684 -0.006422742 -0.14174026 0.01064497 -0.12374763
[5,] 0.07341044 -0.028724032 -0.13385014 -0.01298049 -0.06281004
[6,] 0.02312492 -0.038785104 -0.03216275 0.07268793 -0.11918852
[,477] [,478] [,479] [,480] [,481]
[1,] 0.085721515 0.2369088 -0.03163733 -0.04961759 0.07567289
[2,] 0.212540090 0.4052520 -0.06378204 0.06538963 0.06334462
[3,] 0.035656735 0.3395200 -0.12373400 0.06951213 0.03967689
[4,] 0.069634311 0.3115078 -0.04387229 0.01914976 0.02651158
[5,] 0.093301833 0.1765930 -0.06029833 0.04276315 -0.01899371
[6,] -0.007837979 0.4033882 0.01032726 0.09456421 0.03680502
[,482] [,483] [,484] [,485] [,486]
[1,] 0.014224278 -0.04090451 0.028643118 0.005485986 0.024289938
[2,] 0.028082833 0.12406152 0.050737426 0.004382323 0.031838104
[3,] -0.011032891 0.11820289 0.030434420 0.024688704 0.056926142
[4,] 0.058519281 0.02351317 0.002203047 0.014882185 0.109045506
[5,] 0.030299021 -0.03670148 -0.004659429 0.038361084 -0.009311764
[6,] -0.008477365 0.01284167 0.008294596 -0.044905756 0.010071323
[,487] [,488] [,489] [,490] [,491]
[1,] 0.027732164 -0.054697767 0.08244185 -0.01940191 -0.18509653
[2,] -0.079287864 0.041016314 0.07844529 -0.07530592 -0.10736346
[3,] -0.002462003 0.028426407 0.04889518 -0.06274561 -0.01069009
[4,] -0.104643159 0.001387747 0.01470165 -0.03739887 -0.08979299
[5,] -0.052101936 0.134826988 0.06035344 0.02556883 -0.08897312
[6,] -0.078772254 -0.022792758 0.03378720 -0.09432817 -0.05770224
[,492] [,493] [,494] [,495] [,496]
[1,] -0.03261138 0.01393211 0.1644626 0.10143952 -0.01441867
[2,] -0.19953111 0.05215713 0.1580814 0.10161492 -0.05557086
[3,] -0.11720665 0.09111667 0.1566399 0.11439383 -0.04178641
[4,] -0.02815072 -0.02023082 0.2387220 0.11720078 0.06616344
[5,] -0.11564896 -0.05522026 0.1704042 0.08389510 0.07512923
[6,] -0.09523348 0.08016193 0.2092725 0.09535258 -0.05332264
[,497] [,498] [,499] [,500] [,501]
[1,] 0.13447063 0.176436096 -0.15089904 0.008123890 -0.062278148
[2,] -0.14183965 0.101238340 0.16178432 -0.021955615 -0.004715705
[3,] -0.11346148 0.155305624 0.08963346 0.015225065 -0.032031965
[4,] 0.07938032 0.187938437 -0.41815472 -0.008774522 0.033738963
[5,] 0.18068925 0.002046947 -0.19629756 -0.005373829 0.010599384
[6,] -0.17102486 0.110839099 0.01813341 0.027815249 -0.043837361
[,502] [,503] [,504] [,505] [,506]
[1,] -0.06082680 0.16952525 0.006600899 0.10919487 0.03599295
[2,] -0.01016839 0.11328282 0.014151102 0.12925433 0.03840022
[3,] -0.01715080 0.12347469 0.032013722 0.14595447 0.03473345
[4,] -0.02428205 0.11775508 -0.134463638 0.11429659 0.08892217
[5,] -0.08576907 0.08981242 -0.034434706 0.03607088 0.17811798
[6,] 0.01329549 0.08677683 0.127937108 0.19148800 0.04910553
[,507] [,508] [,509] [,510] [,511]
[1,] -0.081771679 -0.109140441 -0.07335753 -0.01502807 -0.01548101
[2,] 0.022215756 -0.021342721 -0.08955568 0.04025942 -0.02196560
[3,] -0.009848425 -0.045117740 -0.05692595 0.01472343 -0.02373696
[4,] -0.019649435 -0.007875388 -0.07495666 0.03273108 -0.04050305
[5,] -0.024837051 -0.084895268 0.02489420 0.10396164 0.08499401
[6,] -0.058013108 -0.079431497 -0.02372424 0.03251337 -0.06706781
[,512] [,513] [,514] [,515] [,516]
[1,] 0.20747209 0.10412335 0.030921176 0.04140276 0.13099532
[2,] 0.24077047 0.07284018 0.027469020 0.10394826 0.11812397
[3,] 0.07832344 0.05361049 -0.003711764 0.01981778 0.14238910
[4,] 0.22885244 0.09878208 0.029369308 0.01469264 0.08092756
[5,] 0.09952058 0.11782581 -0.058057539 0.01267564 0.13141654
[6,] 0.21342711 0.05211563 -0.037015975 0.08124081 0.14627922
[,517] [,518] [,519] [,520] [,521]
[1,] -0.096544601 -0.02722531 0.1704053 0.6414233 -0.10801749
[2,] -0.068766735 -0.03247895 0.2348349 0.4556105 -0.04150981
[3,] -0.074356921 -0.05799698 0.2257889 0.3981168 -0.05121266
[4,] -0.007750449 0.01547960 0.1302545 0.4229303 -0.05532151
[5,] -0.035133030 -0.05410383 0.3415779 0.2393515 0.01129965
[6,] 0.055697769 -0.07908421 0.3142245 0.2538634 -0.13136469
[,522] [,523] [,524] [,525] [,526]
[1,] 0.028488843 0.01229791 0.006769815 -0.02220854349 0.008598752
[2,] 0.090912819 -0.04902017 -0.038836576 -0.05532822385 -0.013462212
[3,] 0.041311838 0.05117850 -0.030412136 0.00006190916 0.024389319
[4,] 0.089615382 0.05270386 0.011018316 0.00578867877 0.048756767
[5,] 0.005162219 -0.01371515 0.028771298 -0.07557101548 0.118265748
[6,] 0.070394009 0.04985644 -0.056496751 -0.04647116736 0.046551116
[,527] [,528] [,529] [,530] [,531]
[1,] -0.080438398 -0.05049169 0.06124162 -0.037969735 -0.10010156
[2,] -0.052286796 0.05558256 0.04355393 -0.065679953 0.28628990
[3,] -0.053335365 0.05906692 0.07683131 0.002506749 0.15025698
[4,] 0.050195921 0.04279092 0.01739311 -0.035167418 0.07004783
[5,] 0.004074886 0.08705671 0.13898785 -0.020913765 0.01851276
[6,] -0.033718653 0.01462394 0.15657954 0.006698030 0.16144638
[,532] [,533] [,534] [,535] [,536]
[1,] -0.1132798 0.05667033 0.024161274 -0.03244631 -0.02328633
[2,] -0.1149235 0.14032076 0.022697564 -0.08682737 -0.01391359
[3,] -0.1466271 0.07502884 0.012020401 -0.04629718 0.03811403
[4,] -0.1270624 0.04202068 -0.072816454 -0.04554997 -0.06863053
[5,] -0.1100831 0.17043321 -0.002551615 -0.16728048 0.06786533
[6,] -0.1331794 0.06237527 0.017379900 -0.07297575 0.03169990
[,537] [,538] [,539] [,540] [,541]
[1,] -0.049195871 -0.05195329 0.10871506 0.004009936 0.04403062
[2,] 0.079532564 0.10515817 0.20094171 0.148961648 -0.09903095
[3,] -0.007620021 0.04351531 0.04169322 0.079800084 0.05986871
[4,] -0.082801260 -0.01348173 0.09745122 0.073346667 0.11053089
[5,] -0.010112019 0.02520639 0.14831597 -0.052286886 -0.07703506
[6,] -0.040300995 0.02824445 0.13761625 0.132395297 0.06715680
[,542] [,543] [,544] [,545] [,546]
[1,] -0.09582030 0.061663870 0.10744517 0.060571976 0.02810172178
[2,] -0.09636804 0.151209295 0.13660660 0.107330613 0.05540509522
[3,] -0.01025726 0.078234747 0.10478605 0.050891187 0.03553915024
[4,] -0.05504660 0.001779500 0.10987019 0.024541641 0.15697939694
[5,] -0.02101547 0.126134664 0.09540144 0.086240515 0.10588035733
[6,] -0.02692613 -0.007448914 0.05709149 0.003051612 0.00007900961
[,547] [,548] [,549] [,550] [,551]
[1,] 0.02419191 0.08803953 -0.080621943 -0.074648671 -0.03054844
[2,] 0.05273153 0.07319796 0.049742538 -0.011444277 -0.04701106
[3,] 0.06160079 0.09243686 0.001928369 0.070776083 0.05945547
[4,] 0.09536791 0.07475567 -0.086712070 0.001008996 0.13148466
[5,] 0.03845917 0.03740457 -0.089416340 0.134222209 -0.03225615
[6,] 0.03995414 0.01827375 -0.035682827 0.096883036 0.09749158
[,552] [,553] [,554] [,555] [,556]
[1,] 3.490957 0.09625969 0.059705943 -0.2869728 -0.07438415
[2,] 3.009406 0.06977017 0.016659489 -0.2880733 0.00384901
[3,] 2.826385 0.09348783 0.016458966 -0.2091832 -0.02817199
[4,] 2.873447 0.06551965 0.091334976 -0.3344169 -0.03123012
[5,] 2.630254 0.01768534 -0.009353253 -0.1667103 0.03629993
[6,] 2.829683 0.14530991 0.045351252 -0.3220121 -0.02746979
[,557] [,558] [,559] [,560] [,561]
[1,] -0.040171362 0.002730965 -0.04682355 -0.07253763 -0.007843177
[2,] 0.003828358 0.015141261 -0.02566535 0.01270058 0.016795876
[3,] 0.013223354 0.004305525 -0.02875073 -0.03749710 0.011652901
[4,] 0.006316597 0.009411959 -0.02258588 -0.11649830 0.015000288
[5,] -0.050341222 -0.014990398 -0.06293204 -0.13567844 0.025790883
[6,] -0.016510585 0.100776270 -0.02727570 -0.01096613 0.043969691
[,562] [,563] [,564] [,565] [,566]
[1,] -0.10107207 -0.090766735 0.05772920 0.0357586853 -0.007650903
[2,] 0.25792950 -0.004117329 -0.04113457 -0.0826064125 0.031086469
[3,] 0.14507194 -0.033674099 -0.00137327 -0.0002648491 0.002827710
[4,] -0.24326281 -0.060469653 0.04351293 -0.0448633507 0.019339940
[5,] -0.33636457 -0.015884975 0.11548383 0.0600102246 0.033983886
[6,] -0.03306252 -0.088506110 -0.01203969 -0.1086494625 -0.042369910
[,567] [,568] [,569] [,570] [,571]
[1,] 0.15585314 0.13051005 0.108799525 0.064547881 -0.007139327
[2,] 0.01048216 0.13346034 0.059202123 0.051440962 -0.097843759
[3,] 0.03364506 0.08602677 0.066494778 0.020454615 -0.141242966
[4,] 0.16724968 0.18270221 0.004842736 0.019932335 -0.105267487
[5,] 0.19563849 0.05251458 0.017202612 0.179404736 0.375534475
[6,] 0.07881544 0.13055730 0.071095765 0.004675159 -0.218478486
[,572] [,573] [,574] [,575] [,576]
[1,] 0.0058474680 -0.0531055890 0.11780847 -0.03810208 0.019046675
[2,] -0.0034160153 -0.0007439902 0.19959642 0.04476420 -0.036860768
[3,] -0.0167324562 -0.0843516439 0.29047588 0.04091063 -0.002043449
[4,] -0.0376024060 0.0235952139 0.06060461 -0.06478819 0.069602810
[5,] 0.0257282034 -0.0984239876 -0.03339000 0.03665282 0.051747896
[6,] -0.0002246065 0.0356406122 0.26451844 -0.04111731 0.015969321
[,577] [,578] [,579] [,580] [,581]
[1,] 0.051728375 0.2837152 -0.12573980 0.04450747371 -0.20007625
[2,] 0.006162872 0.2887946 -0.14360166 0.12143808603 -0.07812190
[3,] 0.032963041 0.2407141 -0.13535056 0.05022520199 -0.03726773
[4,] 0.007787528 0.3056432 -0.10764431 0.00005984147 0.01136403
[5,] 0.043765217 0.4460579 -0.18649001 0.03132902831 -0.18883580
[6,] 0.013649425 0.2142384 -0.00264157 0.05455103889 -0.15630220
[,582] [,583] [,584] [,585] [,586]
[1,] 0.04763975 -0.1027267799 0.08992080 0.12758245 0.13977332
[2,] 0.03859643 0.0130787063 0.19769299 0.10191844 0.11003129
[3,] 0.05335652 0.0005924911 0.20755954 0.15173234 0.08798728
[4,] 0.07987957 -0.0494213626 0.12524505 0.08972426 0.07025620
[5,] 0.10612362 -0.0147182839 0.10312622 0.20463093 0.27740616
[6,] -0.03431785 0.0195534118 0.06446878 0.16805252 0.12031044
[,587] [,588] [,589] [,590] [,591]
[1,] -0.196053058 -0.146547332 10.55038 0.079190038 -0.04186701
[2,] -0.009361898 -0.084520370 10.62850 -0.006851233 -0.01928166
[3,] -0.027103726 -0.092572533 10.67282 -0.018484965 -0.01760916
[4,] -0.157154799 0.041249577 10.60373 -0.035592694 -0.05346956
[5,] -0.276923925 0.007194216 10.01591 0.077082850 -0.11309950
[6,] 0.087701470 -0.180597544 11.05808 -0.048482083 -0.05305341
[,592] [,593] [,594] [,595] [,596]
[1,] 0.11649291 0.02831738 0.04861200 0.0386349931 -0.01457212
[2,] 0.13541912 0.04426802 0.05433436 -0.0221196022 -0.10279615
[3,] 0.12529573 0.07380189 0.03893021 0.0117186746 -0.06627520
[4,] 0.09005984 0.10297865 0.06968775 0.0643280819 -0.11483820
[5,] 0.06878667 0.08176273 -0.01724512 0.0463816263 -0.08895335
[6,] 0.13597111 0.11060708 -0.03129032 -0.0007398911 -0.11685614
[,597] [,598] [,599] [,600] [,601]
[1,] 0.01919353 0.030889636 -0.02790228 0.0506280921 0.09110180
[2,] -0.05993731 0.039520446 -0.07885469 -0.0756680071 0.03081270
[3,] 0.10984821 0.007104009 -0.09006495 -0.0352274142 -0.01103595
[4,] 0.08354216 -0.054511044 -0.04526887 -0.0006344669 0.07211627
[5,] -0.05610860 0.090620331 -0.03970441 0.1431293339 0.08085971
[6,] -0.07293376 0.055972077 -0.07523298 0.0279906746 0.04177547
[,602] [,603] [,604] [,605] [,606]
[1,] -0.01676150 -0.003624233 0.008825682 -0.2234787 0.18158303
[2,] -0.11423547 -0.006869983 -0.095324494 -0.1961642 0.14314942
[3,] -0.10119756 -0.005852762 -0.058466714 -0.2928435 0.11609706
[4,] 0.03140411 -0.021237850 0.026722971 -0.1151845 0.16916385
[5,] -0.01638347 -0.096810423 0.053151648 -0.2580744 0.07612113
[6,] -0.09530030 0.032139529 -0.049519286 -0.2045097 0.12998132
[,607] [,608] [,609] [,610] [,611]
[1,] 0.07298457 -0.002651701 -0.158432558 -0.04743477 -0.005269919
[2,] 0.11046232 0.057270877 0.016978169 -0.10646354 0.004269409
[3,] 0.18984833 0.023391020 0.003230169 -0.14901696 0.011862932
[4,] 0.02340865 0.045395304 0.039700259 -0.02079147 0.003488605
[5,] 0.06108408 0.064282469 0.080747120 0.16635144 -0.024059182
[6,] 0.09323003 -0.007702209 0.046257153 -0.05669680 -0.016939459
[,612] [,613] [,614] [,615] [,616]
[1,] 0.4457970 0.05577384 0.067969643 0.11045261 -0.13252786
[2,] 0.1118504 0.01980666 0.163218647 0.23445050 -0.05967879
[3,] 0.1646561 0.02292584 0.041179903 0.23108661 -0.09604835
[4,] 0.2329158 0.07637633 0.008157513 0.23833963 0.04642060
[5,] 0.9287996 0.01388288 -0.051213335 0.28340751 -0.15695475
[6,] 0.2541634 0.01503851 0.088469163 0.03579002 -0.12264512
[,617] [,618] [,619] [,620] [,621]
[1,] -0.03382699 -0.06885208 -0.10973601 0.18532184 0.04200668
[2,] 0.01342961 -0.18169832 -0.16695282 -0.02456107 0.05904873
[3,] -0.02139417 -0.13064028 -0.09058248 0.02769518 0.03524665
[4,] -0.06634750 -0.21438241 -0.05371312 0.04360333 0.03625013
[5,] -0.15594494 -0.12468186 -0.04595389 -0.13771467 0.09732056
[6,] -0.10214241 -0.10415285 -0.10364988 0.03797656 0.01805913
[,622] [,623] [,624] [,625] [,626]
[1,] -0.02282365 0.08494413 -0.02972709 -0.2462529 -0.055069294
[2,] -0.02308360 0.07176681 0.02247033 -0.2373391 -0.015013164
[3,] -0.02676908 0.09027924 0.09314279 -0.1643709 -0.012452682
[4,] -0.01139543 0.05307195 -0.02017500 -0.3225598 -0.016039358
[5,] -0.06631549 -0.01779379 -0.13958761 0.3482752 -0.000444417
[6,] 0.08783573 0.02368183 0.20505987 -0.4261086 0.038747206
[,627] [,628] [,629] [,630] [,631]
[1,] 0.024370451 -0.04531929 0.02464755 0.06753983 -0.02750900
[2,] 0.040073313 0.16513161 0.03286229 0.11217613 -0.01320007
[3,] 0.048136637 -0.03035239 0.06777806 0.07820796 -0.02618234
[4,] -0.004290697 0.11767638 0.09995991 0.17675555 -0.06916409
[5,] -0.067067407 0.06463806 0.06637219 0.02278540 -0.12282576
[6,] 0.081883602 0.06337563 0.05944666 0.11099052 -0.05610881
[,632] [,633] [,634] [,635] [,636]
[1,] 0.06387967 0.0353682823 0.01161192 -0.09307051 -0.032301307
[2,] 0.04192519 -0.0545239002 0.04249949 0.04873569 0.057895780
[3,] 0.04624534 -0.0129249850 0.06176883 0.01341312 0.042152233
[4,] 0.10888313 0.0351713225 0.07008977 -0.03464171 0.001583954
[5,] 0.01548626 0.0615639053 -0.03843283 -0.03582926 0.063118577
[6,] 0.01118421 -0.0005861023 0.07010639 0.01689513 0.081836693
[,637] [,638] [,639] [,640] [,641]
[1,] 0.03606339 -0.13619940 -0.051367376 0.10353312 0.07392192
[2,] 0.09408715 -0.08630372 -0.080650181 0.17458060 0.07599048
[3,] 0.04858595 -0.04637498 -0.080615312 0.07917575 0.01036839
[4,] 0.12021314 -0.15209834 -0.119823240 0.04993320 0.03411581
[5,] 0.02005794 -0.13674355 0.002104346 0.07433884 0.12297715
[6,] -0.03113093 0.04155017 -0.085316509 0.05384269 0.09085373
[,642] [,643] [,644] [,645] [,646]
[1,] 0.01333701 -0.00582011 0.15713017 -0.05514756 0.044768147
[2,] 0.06772912 -0.04244962 0.11102190 -0.13224754 0.026957383
[3,] 0.02008614 -0.02806790 0.10794488 -0.14916168 -0.005188774
[4,] 0.04652314 -0.05789090 0.08634548 -0.07793872 0.094190098
[5,] 0.01489882 -0.12299080 0.10937995 -0.01534617 0.117422812
[6,] -0.05196442 -0.05412933 0.09008405 -0.04924094 0.063689373
[,647] [,648] [,649] [,650] [,651]
[1,] 0.08581818 0.14838016 -0.067709140 0.02948107 0.085206084
[2,] -0.01263564 0.16454530 -0.053092696 -0.03030418 -0.033222977
[3,] -0.01956559 0.04567408 0.006813697 -0.03798756 0.004434918
[4,] 0.13683076 -0.11759794 0.035414111 0.06610941 0.062410619
[5,] 0.16712075 -0.05554906 0.101892747 0.07900701 0.012045181
[6,] 0.02136588 0.25598088 -0.050038930 0.04889823 0.038526274
[,652] [,653] [,654] [,655] [,656]
[1,] 0.33459133 -0.19480552 -0.10066294 0.03892896 -0.08909143
[2,] 0.19124396 0.07472620 0.07023271 0.03579077 -0.03493149
[3,] 0.09335737 -0.07692355 0.07608291 0.03562872 0.06468541
[4,] 0.14920172 -0.32679296 0.04796868 0.02999353 -0.08332895
[5,] 0.09121822 -0.18201549 0.01287561 0.15056956 0.03620177
[6,] 0.08416826 -0.10758856 0.08227087 0.01508947 -0.18300064
[,657] [,658] [,659] [,660] [,661]
[1,] -0.05931152 -0.172557011 0.04345829 -0.092010327 0.009216376
[2,] 0.11495795 0.022532800 0.04255837 0.003888385 -0.017729213
[3,] 0.10427144 0.003396329 0.08324926 -0.074082427 -0.050252728
[4,] 0.26004377 -0.111642517 0.06373667 -0.034114234 0.046861809
[5,] 0.17605624 -0.184327334 0.10711108 -0.005935872 0.078089602
[6,] -0.01360951 -0.066098414 0.06643615 -0.034024406 -0.035054497
[,662] [,663] [,664] [,665] [,666]
[1,] 0.026112964 0.04457451 -0.08195589 0.3652456 0.06814873
[2,] -0.084683232 0.20700213 -0.08401885 0.2779030 0.07222094
[3,] -0.041739639 0.16441514 -0.13062321 0.1978280 0.08606069
[4,] 0.006917433 0.01766723 0.12383654 0.3698117 0.14708796
[5,] 0.139725775 0.01032029 -0.12477722 0.8141871 -0.04375590
[6,] -0.119117558 0.09434055 0.01547983 0.5833461 0.07563126
[,667] [,668] [,669] [,670] [,671]
[1,] -0.18481112 -0.10735333 0.05807753 0.149984196 -0.023577670
[2,] -0.05562754 -0.05690396 0.05784097 0.006915372 0.020710021
[3,] -0.10250952 -0.09087744 0.01515261 0.026762316 0.006017368
[4,] -0.14188011 -0.02832006 0.08038715 0.124325506 -0.021963054
[5,] -0.15972200 0.05010274 0.12669383 0.088621408 0.195333421
[6,] -0.06781326 -0.15493165 0.03824890 0.026009392 0.147379860
[,672] [,673] [,674] [,675] [,676]
[1,] -0.09994625 0.05075474 0.13770406 -0.05091312 -0.04950824
[2,] -0.09429576 0.31762967 0.09407511 0.03314918 0.04867224
[3,] -0.10170484 0.17788664 0.01901637 0.07297327 0.03511119
[4,] -0.10722709 0.13335045 0.16321246 -0.11654978 0.04190560
[5,] -0.06281777 0.10059397 0.23034173 -0.08462723 0.04426360
[6,] -0.19650432 0.24314374 0.04436253 0.06214135 0.04953858
[,677] [,678] [,679] [,680] [,681]
[1,] 0.16101447 0.03261756 0.005240528 0.17729074 0.1418883
[2,] 0.08751366 -0.07091376 0.044283517 0.04682508 0.1179714
[3,] 0.05827320 -0.01815493 0.062092572 0.07742473 0.1240227
[4,] 0.17231475 -0.07104249 0.001609321 0.15648434 0.1138151
[5,] 0.16983619 -0.10041435 -0.032318529 0.12371835 0.1463693
[6,] 0.17711435 -0.02248377 0.033749245 0.10109564 0.1119698
[,682] [,683] [,684] [,685] [,686]
[1,] -0.049148161 -0.102843538 -0.06435385 0.03377604 -0.12738264
[2,] -0.110841155 0.005716325 -0.10358587 -0.14668216 -0.06658430
[3,] -0.062345993 0.025146997 -0.05186344 -0.11892558 -0.08773232
[4,] -0.006465571 -0.008823811 0.01966340 -0.04686633 -0.08963613
[5,] -0.018102204 -0.011661214 -0.05419477 -0.01541439 -0.02234121
[6,] -0.046921309 -0.093011886 -0.03803139 -0.08654918 -0.10063978
[,687] [,688] [,689] [,690] [,691]
[1,] 0.01920767 -0.01419010 -0.036548067 0.10385793 -0.11925840
[2,] 0.04427815 -0.02267865 -0.003029384 0.27559093 -0.07172565
[3,] 0.04829218 -0.10402574 -0.074470729 0.21307336 -0.04934324
[4,] 0.12816328 0.01964043 -0.015710143 -0.05150509 -0.11027411
[5,] 0.16518584 -0.06116838 -0.023354217 0.12244792 -0.17023247
[6,] 0.05208472 -0.14492629 -0.004217244 0.20259228 -0.14674774
[,692] [,693] [,694] [,695] [,696]
[1,] 0.12935558 0.08585732 -0.15259826 -0.064426281 0.009427316
[2,] 0.03327186 0.10031641 -0.12604305 -0.060223628 -0.059971269
[3,] -0.03249951 0.09358674 -0.02737276 -0.052089132 -0.034287207
[4,] 0.10765537 0.04947363 -0.18106559 -0.174612015 0.017920753
[5,] 0.05951141 0.13333648 -0.16659611 -0.220832214 -0.016421426
[6,] -0.01870032 0.08445355 -0.05548840 -0.009819379 0.009299650
[,697] [,698] [,699] [,700] [,701]
[1,] 0.07498431 0.008924695 -0.03596460 0.02562026 0.05723343
[2,] 0.08413466 -0.003248119 -0.02388706 0.06124064 0.09032298
[3,] 0.02059310 0.011218891 -0.03507020 0.03977913 0.02634757
[4,] 0.08082996 -0.004628158 -0.07882575 0.19233127 -0.02707683
[5,] 0.04945038 0.018265825 0.06390458 0.17153908 0.04357209
[6,] 0.15937333 0.014907548 -0.03504714 0.01345458 0.01027399
[,702] [,703] [,704] [,705] [,706]
[1,] 0.05042209 0.17513010 0.078270368 0.0009879635 0.07609536
[2,] 0.01899258 0.10236545 -0.003082412 0.0433276631 0.03979125
[3,] -0.01377380 0.09460923 0.039820436 0.0470335819 0.03629850
[4,] -0.07509898 0.09751321 0.005451262 -0.0174586307 0.06780927
[5,] 0.04036519 0.05327782 -0.020448197 -0.0222254954 0.04950605
[6,] 0.00286444 0.20329627 0.061935090 0.0600249246 0.01128719
[,707] [,708] [,709] [,710] [,711]
[1,] 0.08480427 -0.051488783 -0.15092826 0.040600438 0.021364078
[2,] 0.11551305 -0.089709833 -0.09235039 0.054773681 -0.051684495
[3,] 0.04133570 -0.007567647 -0.13295510 0.086913794 -0.010189838
[4,] 0.13612410 -0.022304114 -0.14579950 0.052552368 0.006682473
[5,] 0.13363947 -0.084428973 -0.14787699 -0.033316150 -0.034028500
[6,] 0.10874654 -0.010607310 -0.07875548 -0.002926263 0.017746029
[,712] [,713] [,714] [,715] [,716]
[1,] 0.055909742 0.13373113 0.010450879 -0.07233977 0.049532827
[2,] 0.044699516 0.05596512 0.017389840 -0.01976865 -0.060050644
[3,] -0.003019668 0.09866080 0.008203694 -0.04194739 0.033643007
[4,] 0.106271528 0.10256605 0.050474018 -0.10010678 -0.096137635
[5,] 0.134674683 0.03579661 0.262081206 -0.02019673 -0.058704950
[6,] 0.018991491 0.07984170 0.046879679 -0.13486291 -0.004231149
[,717] [,718] [,719] [,720] [,721]
[1,] -0.15207241 0.01589682 -0.07201874 0.12655738 0.2714218
[2,] -0.14243512 -0.06132271 -0.08397345 0.05954942 0.2686446
[3,] -0.11367873 0.01625160 -0.06947573 0.13009270 0.2074144
[4,] -0.01131313 0.01650861 -0.16232024 0.12199844 0.3521203
[5,] -0.20922038 0.07140674 0.07200902 0.14064504 0.2851988
[6,] -0.18501478 0.01336365 -0.18002975 0.08586299 0.2361627
[,722] [,723] [,724] [,725] [,726]
[1,] -0.04793752 0.1239760 -0.042619105 0.07675026 0.04989492
[2,] -0.03580271 0.2204790 0.028894657 0.07819990 0.03738726
[3,] -0.04341270 0.1997167 0.009197655 0.10368587 0.06880984
[4,] -0.01400930 0.1125405 -0.013918034 0.10096098 0.07105603
[5,] -0.03376498 0.2289448 -0.006609058 0.08865908 0.02157804
[6,] -0.09421291 0.2373826 -0.087017901 0.13768604 0.07877830
[,727] [,728] [,729] [,730] [,731]
[1,] 0.11111774 0.12066169 -0.08823191 -0.0968144462 -0.003828065
[2,] 0.09153498 0.01680492 0.05834011 -0.1283439696 -0.086855493
[3,] 0.02735950 0.01842253 0.05487081 -0.0598209202 -0.041060273
[4,] 0.15378579 0.08465433 -0.09540128 -0.0794036761 -0.066965066
[5,] 0.22088622 0.12059090 -0.18659893 -0.0002434805 0.124148265
[6,] 0.01092780 -0.05189246 -0.05732826 -0.0068929754 -0.059818584
[,732] [,733] [,734] [,735] [,736]
[1,] -1.0205674 -0.012650539 -0.07955996 -0.19061120 0.24889600
[2,] -1.6376132 -0.027073890 -0.11495793 0.02188260 0.27936694
[3,] -1.3168830 0.028417423 -0.15257415 0.01262438 0.11415002
[4,] -0.8893182 -0.003889868 -0.03194398 -0.10278581 0.14121774
[5,] -1.3300040 -0.001954583 -0.11487593 -0.01644935 0.06424145
[6,] -1.0931637 0.005661166 -0.04133619 -0.03086518 0.11152110
[,737] [,738] [,739] [,740] [,741]
[1,] -0.003787148 -0.02626314 -0.05684900 -0.030116322 0.019574083
[2,] 0.031762563 -0.19462261 0.03391609 -0.065266207 0.010448777
[3,] -0.028514821 -0.09818638 0.05229101 -0.056107655 -0.002290886
[4,] -0.013125353 -0.09966719 -0.01316734 -0.062725045 0.047559965
[5,] 0.006487907 -0.21648905 -0.03054102 -0.003993882 -0.035927922
[6,] 0.143368512 -0.06219042 0.01643150 0.027760662 0.167845950
[,742] [,743] [,744] [,745] [,746]
[1,] -0.006300187 0.11072528 0.06599118 0.104969658 0.11591630
[2,] 0.039824650 0.11417527 0.07130589 0.086033270 0.07507633
[3,] -0.046479836 0.07696974 0.11749076 0.069948621 0.07018101
[4,] 0.001496303 0.11861439 0.06500278 0.093097188 0.08963138
[5,] -0.009119453 -0.01157343 0.12341224 0.069648638 0.06475202
[6,] -0.055967491 0.04665795 0.05940204 0.004410517 0.11607914
[,747] [,748] [,749] [,750] [,751]
[1,] -0.005869865 -0.09371068 -0.07998058 0.5072689 0.15181084
[2,] -0.013162416 -0.08033861 -0.08842883 0.4089560 0.18010509
[3,] -0.030671582 -0.08326717 -0.20276427 0.3482460 0.08906674
[4,] -0.036494512 -0.02704215 0.01600152 0.2208505 0.13019434
[5,] 0.059290923 -0.02641463 -0.26967326 0.1779452 0.25794142
[6,] 0.017716359 -0.08491317 -0.08338597 0.4885524 0.10065948
[,752] [,753] [,754] [,755] [,756]
[1,] -0.2158261 0.05548894 0.006289285 -0.021548092 -0.012992766
[2,] -0.1794356 0.16941381 0.060302734 0.026785025 0.017900588
[3,] -0.2917365 0.14918669 0.006558592 0.059029546 0.060162686
[4,] -0.2923160 0.05454070 0.049739074 -0.055772901 0.020266797
[5,] -0.3163047 0.04446334 -0.182113379 -0.017461553 -0.096357614
[6,] -0.2533574 0.23800616 0.053148732 0.007075642 0.005899848
[,757] [,758] [,759] [,760] [,761]
[1,] -0.004315879 0.08018567 -0.16251971 -0.12237902 -0.099664904
[2,] 0.021114955 0.01345702 -0.12080519 -0.06235048 0.159044981
[3,] 0.024573060 0.07193569 -0.06111015 -0.04808743 -0.002424658
[4,] 0.051165286 0.05130168 -0.16208030 -0.12310728 -0.090935059
[5,] -0.124562979 0.13982485 -0.18622497 -0.12187486 -0.046656270
[6,] 0.037395142 0.01761835 -0.05774543 -0.06053047 0.041841812
[,762] [,763] [,764] [,765] [,766]
[1,] -0.06233726 0.1447253 0.1683183 -0.19668962 0.0165074896
[2,] -0.04395547 0.2787576 0.1744189 -0.01972667 0.1150709465
[3,] -0.01668818 0.1851185 0.1324145 0.05224041 -0.0654691830
[4,] 0.02574161 0.1451475 0.1177684 0.06272639 -0.0085238395
[5,] 0.03204844 0.1277810 0.1642708 -0.14526126 0.0274618156
[6,] -0.07035222 0.1358655 0.1458258 -0.19299366 0.0009176398
[,767] [,768]
[1,] 0.067714356 -0.02958016
[2,] -0.040427078 0.03495659
[3,] 0.001104798 0.03656437
[4,] 0.010757907 -0.03644707
[5,] 0.004185256 0.02862171
[6,] -0.015431712 0.02789298It took about 51 minutes on my computer. So, you may want to export these embeddings as an external file to save time. It is not a good idea to run this repeatedly every time we need these embeddings. So, you run it first and then export this embedding matrix as a .csv file. Whenever we need this matrix, we can just read them into our R environment instead of re-doing this analysis. Below, I am appending the target outcome to the embedding matrix, and then exporting them all as a .csv file.
read.embeddings <- as.data.frame(read.embeddings)
read.embeddings$target <- readability$target
write.csv(read.embeddings,
here('data/readability_features.csv'),
row.names = FALSE)Note that it takes significantly less time to compute sentence embeddings if you have access to computational resources with GPU. For instance, if you run the same analysis above on a Kaggle notebook with GPU turned on, it only takes 70 seconds. So, it is important to use GPU resources when using these models if you have access. You can check the associated Kaggle notebook for the analysis in this post.
https://www.kaggle.com/code/uocoeeds/lecture-2b-data-preprocessing-ii