Data Pre-processing II: Text Data

Cengiz Zopluoglu (University of Oregon)
07/07/2022

[Updated: Wed, Sep 20, 2023 - 17:31:16 ]

Generating features from text data is very different than dealing with continuous and categorical data. First, let’s remember the dataset we are working with.

readability <- read.csv(here('data/readability.csv'),header=TRUE)

# The first two observations

readability[1:2,c('excerpt','target')]%>%
    kbl(format = 'html',
        escape = FALSE) %>%
    kable_paper(c("striped", "hover"),full_width = T) %>%
    kable_styling(font_size = 14)
excerpt target
When the young people returned to the ballroom, it presented a decidedly changed appearance. Instead of an interior scene, it was a winter landscape. The floor was covered with snow-white canvas, not laid on smoothly, but rumpled over bumps and hillocks, like a real snow field. The numerous palms and evergreens that had decorated the room, were powdered with flour and strewn with tufts of cotton, like snow. Also diamond dust had been lightly sprinkled on them, and glittering crystal icicles hung from the branches. At each end of the room, on the wall, hung a beautiful bear-skin rug. These rugs were for prizes, one for the girls and one for the boys. And this was the game. The girls were gathered at one end of the room and the boys at the other, and one end was called the North Pole, and the other the South Pole. Each player was given a small flag which they were to plant on reaching the Pole. This would have been an easy matter, but each traveller was obliged to wear snowshoes. -0.3402591
All through dinner time, Mrs. Fayre was somewhat silent, her eyes resting on Dolly with a wistful, uncertain expression. She wanted to give the child the pleasure she craved, but she had hard work to bring herself to the point of overcoming her own objections. At last, however, when the meal was nearly over, she smiled at her little daughter, and said, “All right, Dolly, you may go.” “Oh, mother!” Dolly cried, overwhelmed with sudden delight. “Really? Oh, I am so glad! Are you sure you’re willing?” “I’ve persuaded myself to be willing, against my will,” returned Mrs. Fayre, whimsically. “I confess I just hate to have you go, but I can’t bear to deprive you of the pleasure trip. And, as you say, it would also keep Dotty at home, and so, altogether, I think I shall have to give in.” “Oh, you angel mother! You blessed lady! How good you are!” And Dolly flew around the table and gave her mother a hug that nearly suffocated her. -0.3153723

The excerpt column includes plain text data, and the target column includes a corresponding measure of readability for each excerpt. A higher target value indicates a more difficult text to read. What features can we generate from the plain text to predict its readability?

In the following sections, we will briefly touch on the Transformer models and demonstrate how to derive numerical features to represent a text.

1.Natural Language Processing

NLP is a field at the intersection of linguistics and computer science with the ultimate goal of developing algorithms and models to understand and use human language in a way we understand and use it. The goal is not only to understand individual words but also the context in which these words are being used.

The recent advancements in the field of NLP revolutionized the language models. These advanced language models take plain text, put it into smaller pieces (tokens), then use very complex neural network models to convert these tokens into a numerical vector representing the text.

Most recently, a group of scholars called these models as part of Foundation Models. Below shows a development timeline of the most popular language models.

Below is a brief list of some of these NLP models and some information, including links to original papers. These models are very expensive to train and use the enormous amounts of data available. For instance, Bert/Roberta was trained using the entire Wikipedia and a Book Corpus (a total of ~ 4.7 billion words), GPT-2 was trained using 8 million web pages, and GPT3 was trained on 45 TB of data from the internet and books.

Model Developer Year # of parameters Estimated Cost
Bert-Large Google AI 2018 336 M $ 7K
Roberta-Large Facebook AI 2019 335 M ?
GPT2-XL Open AI 2019 1.5 B $ 50K
T5 Google AI 2020 11 B $ 1.3 M
GPT3 OpenAI 2020 175 B $ 4.6 M

All these models except GPT3 are open source. They can be immediately utilized using open libraries (typically Python), and these models can be customized to implement specific tasks (e.g., question answering, sentiment analysis, translation, etc.). GPT3 is the most powerful developed so far, and it can only be accessed through a private API, https://beta.openai.com/.

You can explore some GPT3 applications on this website, https://gpt3demo.com/. Below are a few of them:

If you have time, this series of Youtube videos provide some background and accessible information about these models. In particular, Episode 2 will give a good idea about what these numerical embeddings represent. If you want to get in-depth coverage of speech and language processing from scratch, this freely available book provides a good amount of material. Finally, this free course by Hugging Face provides a nice an easy introduction to transformer models. While the course primarily utilizes Python, it is still useful to read through to get familiar with concepts.

In this class, we will only scratch the surface and focus on the tools available to make these models accessible through R. In particular, we will use reticulate package and sentence_transformers module (a Python package) to connect with HuggingFace’s Transformers library and explore the word and sentence embeddings derived from the NLP models.

You can consider Hugging Face like a CRAN of pre-trained AI/ML models, it includes a wide variety of language models. There are thousands of pre-trained models that can be imported and used within seconds at no charge to achieve tasks like text generation, text classification, translation, speech recognition, image classification, object detection, etc.

Hugging Face Model Repository


2. Text Encoding the reticulate package and sentence_transformers

First, we will load the reticulate package and sentence_transformers module. While we import the sentence_transformers module we will assign a name to save as an object so we can utilize it moving forward.

require(reticulate)

st <- import('sentence_transformers')

Next, we will pick a pre-trained language model to play with. It can be any model listed in the previous section. You have to find the associate Huggingface page for that particular model and use the same tag used for that model. For instance, suppose we want to use the RoBERTa model. The associated Huggingface webpage for this model is https://huggingface.co/roberta-base.

Notice that the tag for this model is ‘roberta-base’. Therefore, we will use the same name to load this model. For other models, you can use the search bar at the top. When you run the code in the next chunk the first time, it will install all the relevant model files (https://huggingface.co/roberta-base/tree/main) to a local folder on your machine. The next time you run the same code, it will quickly load the model from the local folder since it is already installed on your computer.

model.name <- 'roberta-base'

roberta       <- st$models$Transformer(model.name)
pooling_model <- st$models$Pooling(roberta$get_word_embedding_dimension())
model         <- st$SentenceTransformer(modules = list(roberta,pooling_model))

One important thing to be aware of about these models is the maximum number of characters they can process. It can be found by using the following code. For instance, RoBERTa can handle a text sequence with a maximum number of 512 characters. If we submit any text with more than 512 characters, it will only process the first 512 characters.

model$get_max_seq_length()
[1] 512

Another essential characteristic is the length of the output vector when a language model returns numerical embeddings. The following code reveals that RoBERTa returns a vector with a length of 768.

model$get_sentence_embedding_dimension()
[1] 768

In short, RoBERTa can take any text sequence up to 512 characters as input and then return a numerical vector with a length of 768 that represent this text sequence. This process is also called encoding.

For instance, we can get the embeddings for a single word ‘sofa’. The following will return a vector with a length of 768.

model$encode('sofa')
  [1] -0.0356739610  0.0091452915  0.0451551154 -0.0228319988
  [5]  0.4442713559 -0.2135011852  0.0167765897 -0.0311041381
  [9]  0.0107637532 -0.1096956134 -0.2183851302 -0.1140032262
 [13]  0.1238908470 -0.0797361359  0.1692416519  0.0336829498
 [17] -0.0600813031  0.0623767339  0.0907270387 -0.0224188231
 [21] -0.0487387851  0.1461644173 -0.0409476534  0.0489805304
 [25] -0.0786152929 -0.0014594514  0.1224116161  0.0160395801
 [29] -0.0279184822 -0.0633803979 -0.2180166543 -0.1305485517
 [33]  0.0690473542 -0.0019865464  0.0430623516  0.0606660955
 [37]  0.0769219324  0.0823243707 -0.0091244802  0.0740725845
 [41] -0.0998382196  0.0193559173 -0.1617818475  0.0065892581
 [45] -0.0066350996 -0.0094996877  0.1424297392 -0.1620815396
 [49]  0.0353107899 -0.0427614897  0.0912168026 -0.0695206448
 [53] -0.0678907335  0.0852721781 -0.0525358729 -0.1284755319
 [57]  0.0785271227 -0.0650885701 -0.0774637461  0.0362805724
 [61] -0.0768732131  0.5039720535 -0.0417392813  0.0190712139
 [65] -0.0342553258  0.0591300614 -0.0683486015  0.2984635830
 [69]  0.1031861901 -0.0457865521  0.0050541554 -0.0820528343
 [73]  0.0670195296  0.0963044539 -0.0055563236 -0.0143450852
 [77]  0.0891769677 -2.4715216160 -0.1521035582  0.0507060960
 [81]  0.0713680387 -0.0759579390  0.6373476386  0.1234835237
 [85]  0.0974773467  0.0023111589  0.0176451337  0.2336518466
 [89] -0.0200673547  0.0513754599  0.0578624979  0.0382901579
 [93]  0.0388909206  0.0787570849  0.0269535370  0.0421335399
 [97] -0.0185404010  0.3166861236 -0.0640645251  0.0246435348
[101] -0.0877356082 -0.0269688834  0.0998412147  0.0831300467
[105] -0.1081224978  0.1028029099 -0.1278326511 -0.0900091380
[109] -0.1370072365 -0.0222846027 -0.1231006011  0.2747447789
[113]  0.1733784825 -0.0460299775 -0.0388567075  0.0479775555
[117] -0.0237231664  0.0516280644  0.0417753085  0.1405762136
[121]  0.0398786888  0.1218406260  0.1547902524 -0.0799253136
[125] -0.2430792302  0.0188864060  0.1381260455 -0.0364184044
[129] -0.0737973154  0.0934374630 -0.0591127388 -0.1949139088
[133] -0.0084962826  0.1367645711  0.0814273059 -0.0439461172
[137] -0.0625772253  0.0191264357  0.1192571372 -0.0691679865
[141]  0.0121560153  0.0242042560  0.1154776216 -0.0031788489
[145]  0.1741372645 -0.0381856300  0.0096333232 -0.0517109446
[149] -0.2065927684  0.2168765217  0.1562301964 -0.1177057773
[153]  0.0559231862 -0.0408602990 -0.0578732491  0.1034204736
[157]  0.1974046826  0.0587377064 -0.0360219218 -0.0513394848
[161]  0.0466131195 -0.1661968976  0.0014134059  0.0006979322
[165] -0.0763303414  0.0016987236  0.0691462085  0.0510523655
[169] -0.0452497005  0.0557559207 -0.0133551341  0.0120415296
[173] -0.0284588616  0.0128517095  0.0009869952 -0.0887095928
[177]  0.0629096702 -0.0487924740 -0.0417405814 -0.0330066457
[181] -0.0286348350 -0.0158590674 -0.1413763165 -0.0421915129
[185]  0.0825778693  0.0744538307 -0.0357263014 -0.1307719201
[189] -0.1297859699  0.0350345746  0.1615838110  0.0179401282
[193] -0.0293479897 -0.0170247853  0.0378078744  0.0269139335
[197] -0.1672320217 -0.0403192937 -0.0556905754 -0.0660827383
[201] -0.0173227638 -0.0607024953  0.1821020246  0.0161704849
[205]  0.2305682898 -0.0419338197 -0.1288991123  0.0448455289
[209]  0.0064716600 -0.0127650741 -0.0925187841  0.1807894111
[213]  0.0710934252  0.1928009093 -0.1210669428 -0.1314722449
[217] -0.0510648154 -0.4452689588  0.1560137719 -0.2141953409
[221]  0.0473200753  0.0048588449 -0.1239974946 -0.1737168282
[225] -0.1687250882 -0.1179471463  0.0520940572  0.0320896581
[229]  0.0264194682 -0.0294446461  0.1118273884  0.1000626013
[233]  0.2142880708 -0.0209907908  0.1219721958 -0.0776944458
[237] -0.0059377681  0.0226883367 -0.0174616352  0.0608575717
[241]  0.0128563922 -0.0122666284  0.0205464363  0.1535492539
[245] -0.0558923967  0.0173551757 -0.0106957164  0.3792691827
[249] -0.0184841342 -0.0758697316 -0.0823302120 -0.0419104174
[253]  0.0146229882 -0.0516287647 -0.0121405581  0.0141355302
[257] -0.0988652408  0.0112233525  0.0774115101  0.1352834553
[261]  0.0283605196 -0.0186086819 -0.0428918973 -0.1596861631
[265] -0.0418169945 -0.0641659349  0.0253907926  0.0114793517
[269] -0.0815594047 -0.0027431045  0.1337629259 -0.0245217867
[273]  0.0282561723 -0.0723891556  0.0336038843 -0.0491962805
[277]  0.2089185268 -0.0338551402 -0.0591803417 -0.0615116805
[281]  0.0708776638  0.0354636088 -0.1486814171  0.0963897035
[285]  0.0737084821  0.0070018056  0.2741011083 -0.0709664822
[289] -0.0759047121  0.0596543550  0.0633541495  0.1221976727
[293]  0.0663689300 -0.0255231652 -0.0601295643 -0.0410300568
[297]  0.0213434175 -0.0070217536  0.0664876178  0.0375904702
[301]  0.0977534801 -0.0357051492 -0.0466797203  0.0041690161
[305]  0.1315060258 -0.0527024977 -0.0580320247  0.0049279444
[309] -0.0824159011  0.0807028711  0.0243882202  0.0074504651
[313] -0.0792178810  0.0894088000  0.0450709686  0.0140973330
[317] -0.1279232353  0.0452108681  0.0370465592  0.0794232488
[321]  0.0484420918 -0.0275568068  0.0909292921  0.1273204237
[325] -0.0044540651  0.0747541636  0.0438659079  0.0720247105
[329] -0.0906757563  0.1686510891 -0.0826850086  0.4302483201
[333]  0.1092576087  0.0815252513  0.1608462334  0.2359179258
[337]  0.0666487738 -0.0231011249  0.1278099120  0.1643448323
[341] -0.0311187897 -0.0091495812 -0.0372512080  0.0233513340
[345]  0.1186399907  0.0678060576  0.0010681981 -0.0119118299
[349]  0.0046485681  0.0117309950 -0.0047438201  0.0092348186
[353] -0.0281289481 -0.1587170810 -0.0635980815  0.2193659097
[357]  0.0223285761  0.1418938637 -0.0243899096  0.1697532982
[361]  0.0401152596  0.0707843602  0.0132805128 -0.0120259793
[365]  0.1322512329 -0.0730908960 -0.1636713296 -0.0757417679
[369]  0.0443388149  0.1403741688  0.0351632163  0.0272783544
[373] -0.0755953714  0.0670917109  0.0744388178 -0.0585914142
[377]  0.0665109158  0.0554741733  0.1915322989  0.0042239279
[381]  0.0241412483  0.0870938003  0.0407261923  0.0380898938
[385]  0.0072629489  0.2295169532  0.0345601663  0.1345981061
[389]  0.0193038937 -0.0737601519  0.0488900095 -0.0320191570
[393]  0.0044139400 -0.1239226386  0.1697745770 -0.0467690229
[397]  0.1255642921  0.0495714769 -0.1245959699 -0.0278481580
[401] -0.0222749729  0.0756490007 -0.0419671908  0.1577912569
[405]  0.1263415068  0.0471821725 -0.0791757703 -0.0848639980
[409]  0.0489037707 -0.0662666783  0.0232489593  0.1550576985
[413]  0.0583984405  0.0501303114 -0.1187660545 -0.1089226231
[417]  0.0051808371  0.1294556260 -0.0263066702  0.0613578483
[421] -0.1572146863  0.1188179851 -0.0304358322 -0.0012861080
[425]  0.0322567225 -0.0624186099  0.1952621043 -0.1082454026
[429]  0.0215926021  0.0031448025  0.0534361675 -0.0518163294
[433] -0.0187338796  0.0358905196  0.1152749881 -0.0206493009
[437] -0.0183112808 -0.0602562875 -0.0933917016  0.0276018120
[441] -0.0309239589  0.0220303740 -0.0335549340  0.1210290939
[445] -0.0852393284 -0.1197768748  0.0796097219 -0.0185298547
[449] -0.0533546135  0.0326319411  0.0140433479  0.0901376978
[453] -0.0106399208 -1.2948679924  0.0549269058  0.2028155327
[457] -0.0292813182 -0.0242747366 -0.2009219229  0.0069828127
[461] -0.0131280888  0.0950084254 -0.0167004801 -0.1093979999
[465]  0.0556762479 -0.0704313815  0.1441860497  0.0586875789
[469]  0.0131810829 -0.0256288871  0.0765602812 -0.0727991164
[473]  0.0087057045 -0.0679870248 -0.0487150811 -0.0322923847
[477]  0.0067269527  0.2760896981  0.1456675082 -0.1109817624
[481]  0.0296200737  0.0961446464  0.1258685142  0.0100035518
[485] -0.0643155798 -0.0085830279 -0.0160746835  0.1137120202
[489]  0.0430779532 -0.1941830814  0.0519818999 -0.1093629897
[493] -0.0540313534  0.0003336649  0.2005086243  0.0755024254
[497]  0.0308930520 -0.1000531092  0.0408554040 -0.0952554420
[501]  0.0385358930  0.0117233684  0.0151376864  0.0827608109
[505] -0.0540767983 -0.0203211699 -0.0348391049 -0.0059033292
[509]  0.0453390293  0.1632901579  0.1114752591 -0.0287137758
[513]  0.0790089965  0.0042176861 -0.0153378677 -0.1155088916
[517]  0.2205435038 -0.0161970071 -0.2082663924 -0.2145530879
[521]  0.0687874034 -0.0167665780  0.0280568413 -0.1220358312
[525] -0.2078153938 -0.0163571201 -0.0281453505  0.0477408022
[529]  0.1477197260 -0.0380651988 -0.0686690956 -0.1238215193
[533]  0.0485135168 -0.0375833437 -0.0017912239  0.0233479757
[537]  0.1342128366  0.0435455702 -0.2266585380 -0.0229836479
[541] -0.1091297865  0.0042014066  0.0208422765 -0.0898816288
[545]  0.0692565739  0.0958191231 -0.0390331931  0.0037433216
[549] -0.0514277034 -0.0427649952  0.0874260515 -0.2977560759
[553]  0.0617639646 -0.0038292734  0.1614622623  0.0619579367
[557]  0.0771042630 -0.1935174614 -0.0958970934  0.2438838184
[561] -0.0766469017  0.2058261037  0.0610172190 -0.0550224334
[565] -0.0674731657  0.1120143756  0.1977238506  0.0133913057
[569] -0.0182942767  0.0311765596 -0.0793673620 -0.0004061926
[573] -0.1822259128  0.0842015147 -0.0151702296  0.0315816365
[577]  0.0143520888  0.0462132841  0.1367394030 -0.1292865872
[581] -0.1191602945  0.0113026714  0.0500270873  0.0091564078
[585]  0.0946571678  0.1466214955 -0.0994028375  0.0686461106
[589] 10.4880447388 -0.0123514729 -0.0012773862  0.0908007324
[593] -0.0558971688 -0.1602755934 -0.0279271528 -0.0967928693
[597]  0.1088774577 -0.0242510661 -0.0238485262  0.0940334499
[601] -0.0809688866  0.0916284621  0.0230508875  0.0944304019
[605]  0.1266701519  0.0251529813  0.1540278941  0.0799024925
[609] -0.0092427004 -0.1325678527 -0.0278560482  0.0196429603
[613] -0.0994739532 -0.0079187285  0.0675237849  0.0466950536
[617]  0.0014124722  0.2096044570  0.0467524007  0.1765374392
[621] -0.0125307851 -0.0876224935 -0.0425623730 -0.0767806694
[625] -0.2339251786  0.0408395901 -0.0243873447  0.1549460888
[629]  0.0910378993  0.0292610079  0.0766360164 -0.0269176289
[633]  0.0165668949  0.0711876675 -0.0904418379  0.0709702373
[637] -0.1378541440 -0.0377802700 -0.0319465138 -0.1898437291
[641]  0.0096299518  0.1230707169 -0.1166381687  0.0054549370
[645]  0.2066617906 -0.0204732902  0.0302161332 -0.0745335370
[649]  0.0918245688  0.0983860195 -0.0038088528  0.1738650054
[653]  0.1944436133 -0.0272036064  0.1342483014 -0.0183334164
[657]  0.0908793360  0.0922514722 -0.0001281835  0.0130358934
[661] -0.0195043273  0.0827303976 -0.0225233156 -0.1205918044
[665] -0.3059235811 -0.0033967942  0.0108995540 -0.1303331256
[669]  0.0572650544  0.1016918644 -0.0377703272  0.1106682941
[673]  0.0756958127  0.0101066353  0.2055893093  0.1658867449
[677] -0.0501063056  0.0134348497  0.0426327512  0.0528929085
[681]  0.0533999354  0.0504605025  0.1714175940  0.0124473581
[685] -0.0630341023 -0.0481487587  0.0119474344 -0.0312205367
[689] -0.0983770266 -0.0657716990  0.0097869402  0.0815106332
[693] -0.0783884451  0.1317924112  0.1393555254  0.0091066100
[697]  0.1090818569  0.0826683417 -0.0873613730  0.0406477526
[701]  0.0024024630  0.0293322615 -0.0107911229 -0.0422949791
[705]  0.0773078799  0.0439093374  0.0041232221 -0.0003319718
[709] -0.0733481720  0.0519525483 -0.1517664492  0.0979920477
[713]  0.1458352655  0.0452605821 -0.0459416397 -0.0361512005
[717] -0.0092587732 -0.0254314225 -0.1035516784  0.0726805553
[721]  0.0867970884  0.0103221089  0.0760935023 -0.0238303263
[725] -0.0003891811 -0.0292554908 -0.1475816667  0.0020689443
[729] -0.1005423963  0.1260626465  0.1335250735 -0.0404047295
[733]  0.0887767822 -0.0295703020 -0.0424162671 -0.0948930085
[737] -0.0572368279  0.0164915603 -0.0415635332  0.0422985479
[741] -0.0588609762  0.1055561453  0.0921511501  0.0129698375
[745] -0.0341896787 -0.0933145285  0.0428062342 -0.1376243681
[749] -0.0494870879 -0.5013434291  0.1010253131 -0.1516790539
[753] -0.1601956934 -0.0478142425 -0.0450621769 -0.0462121964
[757]  0.2260329872 -0.1113839298  0.0209654514  0.0178512931
[761]  0.0428405628  0.1008379236  0.0504300594  0.0481586978
[765]  0.2165928781 -0.1681894660 -0.0393629372 -0.0666962191

Similarly, we can get the vector of numerical embeddings for a whole sentence.

model$encode('I like to drink Turkish coffee')
  [1] -0.01178756263  0.10278499871  0.01093375869 -0.04623499140
  [5] -0.00487077981 -0.04498281330  0.08225313574 -0.03068084642
  [9]  0.00254547270 -0.07485476881  0.00626886077 -0.16109354794
 [13]  0.07325114310 -0.00854813121  0.04085500538  0.28260263801
 [17]  0.11343766004  0.13471494615  0.07055664062  0.36907771230
 [21] -0.02329965308  0.12997290492 -0.08797073364  0.00176735315
 [25] -0.13596564531  0.05665922537  0.11902851611 -0.01500649936
 [29]  0.13772100210 -0.00496985437 -0.08434423804 -0.07868374884
 [33]  0.02161235362 -0.03984801471  0.04456693679  0.05849874020
 [37]  0.11640743166  0.02286028862 -0.00947276782  0.00502380542
 [41]  0.04630419612 -0.32184061408 -0.02034790069  0.01740729809
 [45]  0.01355001330 -0.04638009891 -0.05697692558 -0.14055319130
 [49]  0.07457129657 -0.01287342701 -0.01593326218  0.07576484978
 [53]  0.02938880213  0.04194469377 -0.05589605868  0.03272417933
 [57]  0.03844407946  0.05413730443  0.12071878463 -0.07491374761
 [61]  0.01938630454  0.54147577286 -0.15505477786  0.05381580815
 [65]  0.04042135552 -0.00642709574 -0.00746040652 -0.12155018747
 [69] -0.02452480420  0.10893430561  0.03051396087 -0.08853682876
 [73]  0.04928927124 -0.08943001181  0.01897253469  0.07131873071
 [77]  0.06871882826 -4.13642501831  0.13351145387  0.07664902508
 [81]  0.03651222214 -0.09673640132  0.89217787981 -0.04306836054
 [85]  0.04194186255 -0.05514504015 -0.02103988640  0.17559264600
 [89]  0.01227049716 -0.00386030739  0.04441806674 -0.03551847115
 [93] -0.07538413256  0.11143504083  0.04939413816  0.03816314042
 [97]  0.09854111820 -0.02303134464 -0.00179665210 -0.00085414201
[101] -0.11806513369 -0.02063305676  0.02362795174  0.09661674500
[105]  0.01085869595 -0.12519752979  0.10698405653 -0.03740838915
[109] -0.08884917200  0.13770172000  0.10585375130 -0.09237524122
[113]  0.14154621959 -0.00389125478 -0.05083238333  0.07898531109
[117]  0.04267026484  0.05936061218 -0.06123913825  0.06296721101
[121]  0.05586537346  0.03252293542  0.14736802876  0.07342395186
[125] -0.25260412693 -0.08185942471  0.04785029590 -0.03871662542
[129] -0.01667318121  0.04311851785 -0.04991150647 -0.60922294855
[133] -0.00484278006 -0.06470596045 -0.00291156583 -0.11511138827
[137] -0.01698307693 -0.03271684051 -0.05950184911 -0.12982320786
[141]  0.01724223420  0.03518041596  0.02934072725  0.04171930999
[145]  0.30440011621  0.02517579868 -0.07006555051 -0.23346969485
[149]  0.00844197161  0.05099269748  0.03252385557 -0.04751272500
[153] -0.07027619332  0.08984416723 -0.06273024529  0.14591774344
[157]  0.09863515198  0.25520563126 -0.07795181870  0.43738499284
[161]  0.12964035571  0.01454514638  0.01953442395 -0.02825888619
[165]  0.00075821672  0.00771219516 -0.01024915092  0.04318773746
[169]  0.07650490105  0.08267024904 -0.00568555202  0.03067611344
[173] -0.04012656957  0.14161375165  0.01266532484 -0.13634182513
[177] -0.03952530026  0.09026617557  0.00772870053 -0.01258897781
[181]  0.06947132200  0.05105271935  0.00032814220  0.00196462078
[185] -0.01595257409  0.11271636188  0.15407632291  0.05832265317
[189]  0.11283170432  0.04487172142 -0.04882197082  0.05088605359
[193] -0.02264021337  0.07404132932  0.07896973193  0.10499487817
[197] -0.06692550331 -0.03697898984  0.06937737763  0.04945894331
[201]  0.05113966018 -0.08194012195 -0.10721433163 -0.04897894710
[205]  0.15065754950  0.10129641742  0.02087124810  0.10874668509
[209]  0.04760009423 -0.06162553653 -0.09491002560 -0.12216342241
[213] -0.02830585092  0.03591910750 -0.04520691186 -0.16342914104
[217]  0.06836596876  0.04436348751  0.04822815955  0.41608574986
[221]  0.07999478281  0.04446204752 -0.09777959436  0.00191505952
[225] -0.08722338080  0.11013680696  0.14092494547 -0.07029317319
[229]  0.15053604543 -0.16089598835 -0.02733201906 -0.04974053055
[233] -0.10599211603  0.07982736826  0.09201110154 -0.40470686555
[237]  0.05906889960 -0.01318830065  0.01357291173 -0.02731262147
[241] -0.65026259422  0.08871906251  0.08232256770  0.07668064535
[245]  0.04042013362  0.02460350096 -0.00144912163  0.17354218662
[249]  0.14589069784 -0.04771002010  0.01597190090  0.08966311067
[253]  0.04908165336 -0.11419168115 -0.08502776921 -0.08974553645
[257] -0.12737628818  0.04935332388 -0.15694443882 -0.06124186516
[261]  0.03666267172  0.02004068159  0.04401797429 -0.15641340613
[265] -0.05760531500  0.07650154829 -0.03167368472  0.07931122184
[269]  0.00901504979 -0.06132012978  0.01697015762 -0.02927378938
[273] -0.04857507348  0.02371818013  0.03179942816 -0.04552056640
[277]  0.17627295852 -0.02516534552 -0.05752530321 -0.01505636424
[281]  0.08774642646 -0.02125256509  0.18481005728  0.08228832483
[285]  0.06763889641  0.01308839396 -0.13039453328 -0.03017592058
[289] -0.01873817667  0.08929710090  0.05834455416 -0.03174070269
[293]  0.01390640810 -0.03864267841 -0.09253222495 -0.01728121378
[297]  0.12410937250 -0.04100821540  0.04707189649  0.04714074731
[301]  0.10770967603 -0.00315346196 -0.10042775422  0.08935348690
[305] -0.01404160354 -0.04688004032 -0.07279075682  0.05749002844
[309] -0.06967109442 -0.05545315892 -0.02552834339 -0.14972683787
[313]  0.06309494376  0.15150888264 -0.00864394754  0.01057897694
[317]  0.00592292240  0.00970546529  0.08703348786  0.03069057688
[321] -0.03375400230 -0.06739930809  0.09072256833  0.07848568261
[325]  0.11284592748 -0.08407180011  0.07819942385  0.03995769098
[329]  0.07009632140  0.11188885570 -0.24580949545  0.90001469851
[333]  0.12089532614 -0.01227924973 -0.06359811872  0.03523534164
[337]  0.01611461677  0.08675729483  0.10483931005  0.01012298930
[341]  0.00031804154 -0.00818176940 -0.16627056897  0.00469068484
[345]  0.02130271308  0.07732348144  0.04926919565 -0.05670228973
[349] -0.04631502181  0.10687955469 -0.03332764655  0.01406783424
[353]  0.09957949817 -0.15667900443 -0.00317216013  0.01619793475
[357]  0.13785058260 -0.03695226461  0.01658136211 -0.06813907623
[361]  0.08336272836  0.16922046244  0.00247423816 -0.08443702757
[365]  0.05174981058  0.09740118682  0.26251202822  0.13505578041
[369] -0.04359325022  0.09619217366  0.03377174959 -0.00218817405
[373] -0.01017327979 -0.08413492888 -0.05180362985 -0.07273145020
[377]  0.05030424520  0.08751272410  0.16093406081 -0.03390208632
[381] -0.01043029781 -0.03548621386 -0.01699107513  0.01912876405
[385] -0.07973151654  0.04320683703  0.01989768445 -0.12756203115
[389] -0.03098621033  0.00650840718 -0.07768756151  0.10089147091
[393] -0.07954857498 -0.01790400781  0.01669675484  0.05395016819
[397]  0.03829964250  0.14281614125  0.20642946661 -0.05247383565
[401]  0.04683664814  0.10827600211 -0.06957665086 -0.07571008056
[405] -0.05944715440 -0.01344989147 -0.07810124010 -0.04226115346
[409] -0.15824672580 -0.03212283924  0.09794007242  0.09059050679
[413]  0.01046781149  0.00020543486 -0.06280449033  0.02410167083
[417] -0.05018439144 -0.06793823093  0.00573871192 -0.03653944656
[421]  0.02161061764 -0.01924452372  0.04822736979  0.02471604571
[425]  0.12235145271  0.04452153668  0.13469699025  0.01670137979
[429] -0.02470082045 -0.05284336954 -0.10143402964  0.00922968425
[433]  0.03362737596 -0.04423018172 -0.00413170224 -0.01949813962
[437]  0.00942119583 -0.20146682858 -0.05510338396  0.01366847288
[441] -0.04772661254  0.07698956877  0.06640637666  0.02397813834
[445] -0.14183472097 -0.04575728625 -0.15320336819 -0.00788022485
[449]  0.02135960758 -0.01345346309  0.10530500114 -0.01646697707
[453] -0.03888763115 -1.08305180073 -0.00083741685  0.11160721630
[457]  0.02770528942 -0.01054597273 -0.06605579704  0.04412012547
[461]  0.08192968369  0.04005576298 -0.05635560304  0.05495367944
[465]  0.01402659342 -0.15851949155 -0.03023152798  0.19572809339
[469]  0.01863588765  0.06902951002 -0.01266082004  0.02299657091
[473] -0.00470078411 -0.07729942352  0.01735690981 -0.00720282644
[477]  0.07002413273  0.09092012048  0.03493273631  0.06802241504
[481] -0.01505678706  0.02954206988 -0.01877148636  0.03480780497
[485] -0.10423323512 -0.07202734798 -0.01704173721  0.01502756495
[489]  0.04665532708 -0.06358810514 -0.01287578978 -0.05168087035
[493] -0.01075313706 -0.00320516946  0.19674751163  0.04860872403
[497] -0.41238608956  0.01066310983  0.32675898075 -0.06341576576
[501]  0.02628972009  0.01365064457  0.07002934068 -0.04391351342
[505]  0.07600034028  0.14016662538 -0.03555902466 -0.04067653418
[509]  0.09995693713  0.03394508362  0.05223489180 -0.25556266308
[513]  0.00745464209 -0.01409167238  0.02850508317  0.12841719389
[517]  0.02112706937  0.09976664931  0.02270895615 -0.25903543830
[521] -0.03593028709  0.07121115178 -0.01665394753 -0.01663682610
[525] -0.05931027979 -0.06853275001  0.06115171313  0.03058695793
[529]  0.13712780178 -0.09377148747 -0.06594183296 -0.06134198606
[533]  0.07561255246 -0.00017064391 -0.16877844930  0.04635048658
[537]  0.04027160257  0.13218209147 -0.03819207847  0.07642486691
[541] -0.02910984680  0.12374015898  0.05625952035  0.02131085657
[545]  0.18835608661  0.04942709580  0.12962301075  0.00504925707
[549]  0.04721711576 -0.08219789714 -0.04640511796 -0.12387338281
[553] -0.04727662727  0.01413739100  0.05141320080 -0.04458754510
[557]  0.03157661483  0.12638874352 -0.00524097309  0.08917185664
[561]  0.01452164445 -0.35762175918 -0.01392915286  0.04477771372
[565] -0.03660982102  0.01903883368  0.09178100526  0.05326319113
[569] -0.01747901738 -0.05025598407 -0.01110013016 -0.05249111727
[573] -0.03659915924  0.01587794907 -0.01250017527  0.02968469635
[577]  0.10908561200  0.14437158406 -0.14502903819  0.05590865389
[581]  0.07278285921 -0.04392333329  0.01164120249  0.17424646020
[585]  0.05410258844  0.07681672275  0.07232151926 -0.06711075455
[589] 10.07463550568 -0.01011656411  0.01704577543  0.10929690301
[593]  0.06012175232  0.05607127026  0.02889964171 -0.04166502133
[597] -0.00205596257  0.09235295653 -0.04838714749  0.05196825787
[601] -0.02444161847  0.01730557531  0.01771085337  0.01625886187
[605] -0.28358867764  0.08354127407  0.10569129139  0.01898630336
[609]  0.12275204062  0.03809059784  0.03666390106  0.12680123746
[613] -0.15032386780  0.21821279824  0.18539962173  0.05414790660
[617] -0.00749016646  0.08893932402  0.07488542795  0.05545224249
[621]  0.02915835194  0.00856588595  0.13660992682  0.15385082364
[625] -0.06263649464  0.08125825971 -0.00002325047  0.23185446858
[629]  0.03506195918 -0.09679391980  0.01323065255  0.00519346818
[633]  0.03788876534  0.05919850618  0.09609610587  0.05751947314
[637]  0.03957244754  0.01264949236  0.01535425242 -0.06162425131
[641]  0.02908030897  0.14106319845 -0.01901833341  0.11276496202
[645] -0.03936489671  0.00099390326 -0.00366679300 -0.01762092672
[649] -0.00928323530  0.07514175028  0.06850954145 -0.02549809590
[653]  0.08762409538  0.08077415079  0.06784472615  0.08132497966
[657] -0.01183548942 -0.00072143879  0.02146123536  0.11198233068
[661] -0.07392378896  0.03819230571  0.01816147566 -0.04830361903
[665] -0.19510628283 -0.04690299183 -0.07854089141 -0.05419109017
[669]  0.02331295051 -0.00938901678  0.07046185434  0.09199322015
[673]  0.21238797903  0.02792359702  0.11243189871  0.02591974288
[677] -0.00615646644  0.03513993695  0.14261384308  0.07364098728
[681]  0.10220479965  0.01609489322  0.02398936078 -0.02556908131
[685]  0.00179124018 -0.02348809317  0.08397649974 -0.08257681876
[689] -0.04396900907  0.04995858297 -0.05033384636  0.05998511612
[693]  0.11537389457 -0.01593917795 -0.06055822968 -0.16152115166
[697] -0.01114141382  0.02739814483 -0.01101099607 -0.04443185404
[701] -0.00682633510  0.04704710469 -0.02496541105 -0.08497899026
[705] -0.06010052189  0.06924650073 -0.03039424494  0.07574173063
[709] -0.00660725730  0.03008056991 -0.02600940131  0.03524253145
[713]  0.03677238151 -0.05480838194  0.04589191079 -0.05034032464
[717] -0.02219916880  0.00385648594  0.05007091165  0.08368641138
[721]  0.05869836733 -0.04817376286  0.00500276731  0.01969382726
[725]  0.02232522331 -0.00405918434 -0.03342300653 -0.05019075796
[729] -0.05556573719 -0.13569174707  0.05072744191 -0.48665577173
[733]  0.04441469908  0.02524072118 -0.14115256071  0.17032654583
[737]  0.07977185398 -0.06868468225 -0.03465748578 -0.05387150124
[741] -0.05741538852 -0.02516146377  0.15718893707  0.01091605332
[745] -0.04058590904 -0.01980805956  0.02870250493 -0.01669016480
[749] -0.03890883923 -0.60106384754  0.03322814405  0.02858895808
[753]  0.18336550891  0.12473639101  0.01609408110  0.08886212856
[757]  0.07076863199  0.00996986963 -0.06644231826  0.00503187347
[761] -0.02441483364 -0.03701018542  0.04051119834  0.03330204263
[765]  0.10524793714  0.11114552617  0.07725711912 -0.14208619297

The input can be many sentences. For instance, if I submit a vector of three sentences as an input, the model returns a 3 x 768 matrix containng sentence embeddings. Each row contains the embeddings for a sentence.

my.sentences <- c('The weather today is great.',
                  'I live in Eugene.',
                  'I am a graduate student.')

embeddings <- model$encode(my.sentences)

dim(embeddings)
[1]   3 768
head(embeddings)
             [,1]       [,2]        [,3]        [,4]      [,5]
[1,]  0.017466936 0.18936765  0.05655781 -0.10007770 0.3477369
[2,] -0.116279386 0.15185139  0.02549255 -0.18140650 0.3024701
[3,]  0.004130477 0.09689271 -0.02288255  0.01698708 0.1297401
            [,6]        [,7]        [,8]        [,9]        [,10]
[1,] 0.161116362  0.01379415 -0.06983393  0.21350072 -0.086530611
[2,] 0.007331764  0.03502100  0.09465420 -0.02342363  0.003951203
[3,] 0.100442544 -0.03860680  0.05823556 -0.10520023 -0.094153374
           [,11]       [,12]        [,13]       [,14]       [,15]
[1,] -0.03210545  0.18931536 -0.082832702 -0.04288674 -0.05687425
[2,] -0.06632143 -0.14414917 -0.007048744 -0.07298838  0.11057709
[3,] -0.13373426 -0.02797971 -0.043431252  0.06593540  0.06813642
          [,16]      [,17]       [,18]        [,19]     [,20]
[1,] -0.1995602 0.12531294 -0.25097796 -0.007122722 0.1272842
[2,]  0.1434624 0.02711638  0.06095798  0.015504715 0.3171880
[3,]  0.1352124 0.05530372 -0.05192044  0.129772440 0.1445196
           [,21]      [,22]       [,23]        [,24]       [,25]
[1,] -0.02212711 0.02939240 -0.06768320 -0.031360045 -0.02374818
[2,] -0.11055427 0.17259933  0.06908871  0.007150877 -0.09578121
[3,] -0.19155622 0.08215951 -0.04485236  0.025491279 -0.07901977
           [,26]        [,27]       [,28]      [,29]       [,30]
[1,] -0.01850537 -0.073677890  0.08197053 0.04476932 -0.01092185
[2,]  0.11460673  0.007118554  0.06077866 0.07339842  0.07566937
[3,]  0.14188063 -0.059332389 -0.07300105 0.02767119  0.05440608
          [,31]       [,32]      [,33]      [,34]      [,35]
[1,]  0.0516919 -0.12200159 0.06565627 0.08309685 -0.0631547
[2,] -0.1437625 -0.07774637 0.12881884 0.03798771 -0.2033215
[3,] -0.1472241 -0.08245133 0.04026355 0.04781771 -0.1529378
          [,36]      [,37]      [,38]      [,39]       [,40]
[1,] 0.00124214 0.21495906 0.02378797 0.41673407  0.10881428
[2,] 0.03539575 0.02797152 0.02694622 0.18206938 -0.00243298
[3,] 0.16710928 0.04931019 0.07693321 0.03029568 -0.03445346
           [,41]       [,42]       [,43]       [,44]       [,45]
[1,] -0.02317035 -0.04610297 -0.07775073  0.09374794  0.01631867
[2,]  0.18405415 -0.09677307  0.02205182 -0.05291918 -0.12745722
[3,]  0.04713881 -0.10469180  0.01276998 -0.11525831 -0.12307585
           [,46]        [,47]        [,48]      [,49]       [,50]
[1,] -0.08893959 -0.066087134 -0.033896975 0.03748417 -0.09860551
[2,] -0.05699166  0.026511583  0.005998232 0.04043084  0.09988649
[3,] -0.02619796  0.006607132  0.128890276 0.04518945 -0.02991036
           [,51]        [,52]       [,53]      [,54]       [,55]
[1,]  0.01296319 -0.003461072 -0.02627736 0.01285952 -0.06320502
[2,] -0.03472668  0.126700595  0.05529476 0.04296899  0.01611242
[3,]  0.02033573  0.302788228 -0.01722694 0.13887501 -0.06220450
          [,56]      [,57]       [,58]       [,59]       [,60]
[1,] 0.04111816 0.12291817  0.27477175  0.09285492 -0.05965450
[2,] 0.17848778 0.10158963  0.10257996  0.07757163  0.03783483
[3,] 0.08246204 0.02561423 -0.01797309 -0.01141094 -0.06575820
           [,61]       [,62]       [,63]       [,64]       [,65]
[1,] -0.12136278 -0.05212643  0.01001978 -0.03749729 -0.08881954
[2,] -0.08906478  0.34973344 -0.18619291 -0.24437067  0.02749443
[3,] -0.10261139  0.16414776 -0.19891870 -0.09115140  0.15854540
            [,66]      [,67]      [,68]       [,69]      [,70]
[1,] -0.024980947 0.08160084 0.14402378 -0.02253270 0.18326229
[2,] -0.007333713 0.05363137 0.07141103  0.01306976 0.14572120
[3,] -0.083556786 0.08434479 0.10600642  0.07140820 0.03421079
           [,71]       [,72]       [,73]       [,74]       [,75]
[1,]  0.01987223 -0.10938195  0.05411881  0.02580995  0.05389390
[2,] -0.02115243  0.01261677 -0.01681857  0.05305029 -0.03361567
[3,]  0.04432295  0.18048577 -0.02966901 -0.11892220 -0.02450558
           [,76]       [,77]     [,78]       [,79]       [,80]
[1,]  0.08346283 -0.06182058 -4.744359 -0.18744363 -0.17499693
[2,] -0.02086468  0.13247438 -3.307262  0.13413826  0.10885518
[3,] -0.14510953  0.16692485 -3.742653 -0.01816995 -0.04116233
          [,81]      [,82]     [,83]       [,84]      [,85]
[1,] 0.14713387 -0.1248986 0.9754919 -0.06475981 0.05608290
[2,] 0.07537901 -0.2367227 1.3949689  0.06399761 0.13651498
[3,] 0.02652982 -0.2597603 1.3483980  0.19230933 0.02012401
           [,86]      [,87]        [,88]       [,89]        [,90]
[1,] -0.30756178 0.11022718  0.171431765  0.06668350 -0.003124851
[2,]  0.06031471 0.04747717 -0.005528938  0.02481796  0.014205792
[3,]  0.03678771 0.16980240  0.151860595 -0.04821039 -0.004139557
          [,91]        [,92]       [,93]       [,94]      [,95]
[1,] 0.04622074  0.090181261 -0.04604505  0.06580640 0.14173642
[2,] 0.06329937  0.008838675 -0.07240096 -0.06188769 0.09276354
[3,] 0.01915987 -0.135672256 -0.01942731  0.03034206 0.03634046
           [,96]       [,97]     [,98]       [,99]       [,100]
[1,]  0.18965936 -0.04988672 0.5766389 -0.03957188  0.007752549
[2,] -0.06889861 -0.11589235 0.5682074 -0.07129852 -0.091406807
[3,] -0.07978459 -0.02496983 0.6747148 -0.05331716 -0.107529968
          [,101]      [,102]    [,103]     [,104]      [,105]
[1,] -0.01312273 -0.01181763 0.1199985 0.14943148 -0.10740668
[2,] -0.05813193  0.01646996 0.1975683 0.20346186 -0.05206105
[3,] -0.01322445 -0.06349409 0.2546781 0.09124219 -0.03539053
         [,106]      [,107]      [,108]     [,109]      [,110]
[1,] 0.02258746  0.04812491 -0.06409516 0.04273710 -0.01460021
[2,] 0.11045092 -0.08600713 -0.05832916 0.04531546 -0.05098567
[3,] 0.02597254 -0.03470686 -0.11045704 0.12626635  0.09034445
           [,111]     [,112]      [,113]      [,114]       [,115]
[1,]  0.120807193  0.1195999  0.18925950 -0.09271472 -0.057085268
[2,] -0.001811178 -0.1268563 -0.05092565 -0.05587747  0.096366778
[3,]  0.097552113 -0.2609514  0.02977949  0.08170151 -0.006335007
          [,116]      [,117]     [,118]      [,119]      [,120]
[1,]  0.11585514 -0.05049544 0.07540878  0.01785059  0.06430135
[2,]  0.02522018  0.07276074 0.10370429 -0.07917025  0.01869858
[3,] -0.05168045  0.04032857 0.19675742 -0.01150821 -0.01968286
          [,121]      [,122]      [,123]       [,124]      [,125]
[1,] -0.04298311  0.04079489 -0.06041414 -0.011750890 -0.04550166
[2,] -0.05321378 -0.04124171  0.06694493  0.070510812 -0.21030827
[3,] -0.03093176  0.07614435  0.02510202 -0.008475666 -0.02347328
          [,126]      [,127]      [,128]       [,129]      [,130]
[1,]  0.11097955 -0.24637091 0.046722800 -0.048847396 0.073720053
[2,] -0.10665352 -0.07501517 0.007717835  0.009107843 0.001662996
[3,] -0.05122698  0.01678034 0.023123045  0.031012105 0.063838013
          [,131]     [,132]      [,133]     [,134]      [,135]
[1,] -0.13415056 -0.4292295 -0.02677542 0.14952262 -0.06541855
[2,] -0.03282406 -0.5320446  0.02072983 0.02825750 -0.02982503
[3,] -0.01259000 -0.5687474 -0.15318406 0.07306065  0.05096757
          [,136]      [,137]      [,138]      [,139]      [,140]
[1,]  0.08021230 -0.09341189 -0.02671690 -0.15176196  0.02962985
[2,] -0.07013462  0.01992375 -0.06950717 -0.04408696 -0.09377313
[3,] -0.09520675  0.08959299 -0.04694959 -0.05613213 -0.10142585
          [,141]      [,142]      [,143]       [,144]       [,145]
[1,]  0.16161388  0.07141577  0.06372322  0.005867817 -0.002618913
[2,] -0.01699820 -0.10967018 -0.04513898  0.081730612  0.294857025
[3,]  0.01110352 -0.12602286  0.01570023 -0.051091015  0.124610789
          [,146]      [,147]       [,148]     [,149]     [,150]
[1,] -0.01872567 -0.04991600 -0.027256506 0.05930051 0.03952531
[2,]  0.09415734  0.01551705 -0.115617387 0.06616315 0.12677199
[3,]  0.25578880  0.02818135 -0.007225338 0.01288412 0.15643610
        [,151]      [,152]      [,153]       [,154]      [,155]
[1,] 0.0230126  0.04690588 -0.04385430  0.025889043  0.05686368
[2,] 0.1484294 -0.05647697 -0.05922592  0.063226916 -0.02238526
[3,] 0.1842019 -0.11539790 -0.09148663 -0.006457172  0.01688721
        [,156]      [,157]     [,158]      [,159]     [,160]
[1,] 0.1612850  0.02808929 0.07576993 -0.03871185 0.27184317
[2,] 0.3360443  0.06559707 0.36423922 -0.05806160 0.11002246
[3,] 0.3965186 -0.03016575 0.31495151  0.15312929 0.03696651
         [,161]      [,162]      [,163]      [,164]       [,165]
[1,] 0.29307944 -0.08241996 -0.01799023 -0.11790153 -0.025170870
[2,] 0.09761115  0.05626684  0.03946232  0.03259929 -0.039699692
[3,] 0.17220785 -0.04270339 -0.02529519 -0.03280073 -0.007628142
          [,166]      [,167]     [,168]      [,169]      [,170]
[1,] -0.04706457 -0.03228906 0.01486580  0.03410897  0.08997094
[2,] -0.02353669 -0.12128777 0.05145064  0.01461882 -0.01191414
[3,] -0.02756393 -0.11026121 0.03721116 -0.08949099  0.05856310
          [,171]       [,172]      [,173]      [,174]      [,175]
[1,] -0.04632119  0.135610104 -0.02321601 -0.07550758 -0.16381302
[2,] -0.01514443 -0.038992934 -0.03243395  0.01624453 -0.04762726
[3,] -0.02180461 -0.006510535  0.01781113  0.02623862 -0.04048797
          [,176]     [,177]       [,178]     [,179]     [,180]
[1,] -0.04189295 0.15148470  0.140410155 0.04326902 0.05095452
[2,] -0.11555878 0.08569998 -0.003490022 0.01828323 0.05416968
[3,] -0.16425563 0.17146082  0.068619400 0.13635762 0.09055427
          [,181]       [,182]       [,183]      [,184]      [,185]
[1,] -0.01218278  0.047707740 -0.065614261  0.03087835 0.019091025
[2,] -0.05771073  0.008110725  0.029411763 -0.03026832 0.004953566
[3,] -0.15558219 -0.004117484 -0.008401374 -0.03395857 0.082504667
        [,186]      [,187]      [,188]       [,189]     [,190]
[1,] 0.1010152 0.093787849  0.04519366 -0.149715766 0.02564542
[2,] 0.2768288 0.002896491  0.00288205 -0.002317041 0.20472515
[3,] 0.3093906 0.185895532 -0.05093533  0.102967449 0.16119444
         [,191]      [,192]       [,193]      [,194]       [,195]
[1,] 0.08153410 -0.08363193  0.116248876  0.07510559  0.028269954
[2,] 0.06308736 -0.03121299 -0.009620543 -0.12536697 -0.009901358
[3,] 0.11336213 -0.01572398 -0.039867125 -0.06070736  0.071869873
         [,196]     [,197]      [,198]        [,199]      [,200]
[1,] 0.04374793  0.0306067 -0.01423122 -0.0009407345  0.01116109
[2,] 0.03533378 -0.1049785 -0.04820460 -0.0315684490 -0.05145582
[3,] 0.01109681 -0.1666481 -0.05644229  0.0661051124 -0.07637785
         [,201]      [,202]    [,203]      [,204]      [,205]
[1,] 0.09029138 -0.01473477 0.1183517 -0.06788336 0.002514364
[2,] 0.01361644  0.06719654 0.2151488 -0.06788865 0.020254625
[3,] 0.04770661  0.17415440 0.2358820 -0.01688100 0.109950788
          [,206]      [,207]      [,208]       [,209]      [,210]
[1,] -0.10337599 -0.15819739 -0.10490708 -0.017575335 -0.06240090
[2,]  0.10523003  0.08059917  0.05202673  0.057690587  0.02943062
[3,]  0.02377997 -0.09855437  0.05364608  0.004027244  0.07190191
           [,211]      [,212]      [,213]      [,214]     [,215]
[1,] -0.016532600 -0.07328504  0.08365475  0.34286380 -0.0963589
[2,] -0.008552969 -0.07551909 -0.12199020  0.25189748 -0.0565316
[3,] -0.119144619  0.05820637 -0.08432852 -0.05856914  0.0607432
          [,216]      [,217]     [,218]      [,219]    [,220]
[1,] -0.17888170  0.03668439 -0.7004665  0.04737864 0.1626685
[2,] -0.02578335 -0.05152095 -0.3525909 -0.02983569 0.1501971
[3,] -0.03525455 -0.12300278 -0.2542538  0.16009760 0.1010381
          [,221]      [,222]      [,223]      [,224]      [,225]
[1,]  0.16919723 -0.09332245  0.20004980  0.10661260 0.027264655
[2,]  0.01113881 -0.00366085  0.04691055  0.02603983 0.070807993
[3,] -0.02853836  0.07157905 -0.13754308 -0.03224405 0.009818178
         [,226]     [,227]      [,228]       [,229]      [,230]
[1,] 0.02428964 0.06207667 -0.08166093  0.113831602  0.03132034
[2,] 0.07769687 0.07915758 -0.02231407  0.084806718 -0.15689461
[3,] 0.04967513 0.04366930 -0.13910171 -0.005473904  0.01076712
          [,231]      [,232]        [,233]       [,234]    [,235]
[1,] -0.03456382 -0.07086996 -0.0664970949  0.079126269 0.1576967
[2,] -0.01303482  0.11235482 -0.0472119972 -0.007066698 0.1879414
[3,] -0.06117841  0.13229525 -0.0006693983  0.038082622 0.1642626
          [,236]       [,237]      [,238]      [,239]      [,240]
[1,] -0.07242861 -0.060679540 0.007488072 -0.05117263  0.13693771
[2,] -0.18020511 -0.005515292 0.005323615  0.04557093  0.01427150
[3,] -0.20792490 -0.026204484 0.116029240 -0.00965337 -0.06306633
          [,241]     [,242]     [,243]     [,244]      [,245]
[1,] -0.37703294 0.13546734 0.05247532 0.05501491 0.082340881
[2,] -0.06490818 0.05138187 0.06495947 0.05038793 0.007074311
[3,] -0.41937870 0.14372210 0.04367482 0.12992582 0.131404966
          [,246]      [,247]     [,248]    [,249]      [,250]
[1,] -0.16188540 0.007680578  0.1909865 0.2358013 -0.11898704
[2,]  0.08033013 0.029313516 -0.1486792 0.2157641  0.05247597
[3,] -0.09704037 0.016597759 -0.2120424 0.2251720 -0.04899136
          [,251]     [,252]      [,253]     [,254]      [,255]
[1,] -0.12922350 -0.3348031 -0.01761893 -0.1492761 -0.07322966
[2,] -0.05986992 -0.1188031  0.02589624 -0.1675690  0.01387598
[3,] -0.06133738 -0.1153320  0.13166033 -0.1098961 -0.05030071
          [,256]      [,257]      [,258]       [,259]      [,260]
[1,] -0.09891027 -0.07905637 -0.01703418 -0.002923179  0.02023862
[2,] -0.05357978 -0.16829614  0.07828091 -0.223703027  0.27632055
[3,] -0.17185661 -0.08030650  0.01444841 -0.172713190 -0.07524167
           [,261]      [,262]      [,263]      [,264]     [,265]
[1,] -0.006831818  0.04149275  0.19686872 -0.08984916 -0.1866602
[2,] -0.006285527 -0.09683912 -0.03744879 -0.05834809 -0.1240842
[3,]  0.012716721  0.03523421 -0.02654512 -0.14184952 -0.1396117
        [,266]      [,267]      [,268]     [,269]     [,270]
[1,] 0.1602448 -0.05983455 -0.02839560 0.06783184 0.12312593
[2,] 0.0912225 -0.01839774  0.12244660 0.11336525 0.03489619
[3,] 0.0574608 -0.01124171  0.06315872 0.09125546 0.17926168
          [,271]       [,272]      [,273]     [,274]      [,275]
[1,] -0.01121200  0.031648841 -0.02484243 0.07623786 -0.02644233
[2,] -0.07443111  0.008801795 -0.05950159 0.03754820  0.10479835
[3,]  0.01950239 -0.155382127 -0.19454606 0.11245190  0.02365979
          [,276]     [,277]      [,278]      [,279]       [,280]
[1,]  0.14516488 0.01943621 -0.01519107 -0.01187081 -0.045566306
[2,] -0.07791726 0.25741455  0.05710046 -0.11898427  0.033412673
[3,] -0.07167783 0.06323096  0.05420353 -0.09452247  0.005256354
          [,281]      [,282]      [,283]       [,284]     [,285]
[1,] 0.035979938  0.03678068 -0.11209080 -0.139278978 0.04726018
[2,] 0.008121938  0.01946798 -0.04401416 -0.004070202 0.11919580
[3,] 0.105893590 -0.08386994  0.18485342 -0.035839822 0.15128759
          [,286]      [,287]      [,288]     [,289]      [,290]
[1,] -0.02799588  0.05072744 0.004907768 0.07601693  0.05490066
[2,]  0.01514776 -0.29562968 0.102084860 0.02824203  0.01639785
[3,] -0.05246643 -0.30615622 0.019979175 0.07344486 -0.04757974
         [,291]      [,292]     [,293]      [,294]       [,295]
[1,] 0.09618767 0.151678517 -0.1004529 -0.05030722 -0.116703518
[2,] 0.04637577 0.105601251 -0.1033393  0.02358369  0.032865740
[3,] 0.08255721 0.003930302 -0.1791163 -0.02273582  0.008632692
          [,296]     [,297]      [,298]      [,299]      [,300]
[1,] -0.15197571 0.06356946 -0.06262263  0.05438710 -0.05219115
[2,] -0.01940111 0.15565746 -0.02635029  0.07598012  0.16030227
[3,] -0.00429053 0.17145985  0.02258285 -0.01364348  0.22514419
        [,301]     [,302]      [,303]      [,304]      [,305]
[1,] 0.2050680 0.12845989  0.01921978  0.04048699 -0.02587013
[2,] 0.1675498 0.03746923  0.05011429  0.07070537 -0.04895550
[3,] 0.1897785 0.02442981 -0.05904791 -0.02809922 -0.05312953
          [,306]      [,307]      [,308]      [,309]       [,310]
[1,] -0.06091958  0.22622851 -0.02583806 -0.06351952 -0.001065356
[2,] -0.05661405 -0.01088095 -0.09921473 -0.07185391  0.018533990
[3,] -0.10915315  0.04063140 -0.02099844 -0.16146088  0.019671457
           [,311]      [,312]       [,313]     [,314]       [,315]
[1,] -0.032305688 -0.01437410 -0.053030983 0.02671601  0.162066981
[2,]  0.008852237 -0.05506039 -0.041147631 0.19298290 -0.001432929
[3,]  0.015376883  0.01902910  0.006153993 0.14795077  0.060603369
         [,316]     [,317]      [,318]     [,319]      [,320]
[1,] 0.01248342 0.06690809 -0.01680008 0.03164658 -0.01084370
[2,] 0.04505249 0.16234794 -0.07274230 0.06346707 -0.03178494
[3,] 0.12266167 0.14545971  0.04753947 0.06366099  0.05045570
          [,321]       [,322]       [,323]      [,324]      [,325]
[1,]  0.07335888 -0.007874054 -0.016082630 -0.05392395 -0.06698276
[2,]  0.03584130 -0.144745380 -0.001119758  0.03509476 -0.14086261
[3,] -0.07533805 -0.114872098 -0.048632365  0.10942306 -0.05854078
          [,326]       [,327]       [,328]       [,329]     [,330]
[1,] -0.02696791 -0.017976213  0.025982780  0.036848333 0.01237879
[2,] -0.08170927  0.134990618 -0.008862588 -0.003909879 0.06711595
[3,]  0.06490751 -0.005110458  0.154482007  0.064730100 0.08394097
         [,331]    [,332]     [,333]     [,334]       [,335]
[1,] -0.7021178 0.5374565 0.19869882 0.08592588  0.003259264
[2,] -0.1397800 0.7935132 0.06652986 0.18187265  0.019942252
[3,]  0.6625274 0.6826792 0.03761757 0.13857222 -0.048566770
           [,336]      [,337]    [,338]    [,339]     [,340]
[1,] -0.017559689  0.02492253 0.1249315 0.1226960 0.11163367
[2,] -0.005461998  0.03129506 0.1135423 0.0777054 0.03971887
[3,] -0.087679729 -0.03037414 0.1313429 0.2094652 0.15734860
          [,341]      [,342]      [,343]      [,344]      [,345]
[1,] -0.10634105 -0.10901737 -0.06947979  0.05403144 -0.03136061
[2,] -0.03392104 -0.16822711 -0.16724649  0.06844141  0.04961351
[3,] -0.04125428 -0.09978348 -0.26348612 -0.04369469  0.10635111
            [,346]     [,347]      [,348]      [,349]        [,350]
[1,]  0.0352215320 0.02250233 -0.14609206  0.02603752  0.0008976497
[2,] -0.0002137561 0.10198606 -0.16922621 -0.09600603 -0.1366553754
[3,]  0.0350311548 0.03004424 -0.05039074  0.06706302  0.0474682488
          [,351]      [,352]       [,353]      [,354]      [,355]
[1,] -0.08492935  0.05261917 -0.002712078 -0.04173631 -0.08766926
[2,] -0.08518022 -0.09437098  0.089835979 -0.14466380 -0.05234888
[3,] -0.12240537 -0.04706511  0.197074294 -0.19491069 -0.08034088
          [,356]     [,357]       [,358]      [,359]      [,360]
[1,] -0.01748293 0.08140319 -0.009076188  0.03891879 -0.07069510
[2,]  0.06296342 0.15020922 -0.024204466 -0.01938068  0.26828581
[3,] -0.04289609 0.08904836  0.036470607 -0.06100410  0.03539129
         [,361]    [,362]      [,363]      [,364]       [,365]
[1,] 0.04525856 0.3758443 -0.02190541 0.162575215  0.005307974
[2,] 0.09426238 0.1260188 -0.07778172 0.002552769  0.054705024
[3,] 0.15059383 0.1224859  0.02159095 0.076193169 -0.103104755
          [,366]      [,367]      [,368]      [,369]     [,370]
[1,] -0.01882286 -0.04616634 0.129491597  0.05433006 0.06411678
[2,]  0.04845531  0.09284367 0.110095747 -0.04976790 0.08954338
[3,]  0.13817395  0.10027109 0.005097982 -0.05057735 0.07692035
         [,371]      [,372]       [,373]      [,374]      [,375]
[1,] 0.07350555 -0.09912018  0.034260299 -0.20898157 -0.13316488
[2,] 0.11582971  0.04861606 -0.006673804 -0.07216717 -0.04917652
[3,] 0.07229467  0.08957379 -0.070721515 -0.19933733  0.01460028
          [,376]      [,377]      [,378]      [,379]     [,380]
[1,]  0.07324538  0.06339715 0.008160661  0.02553285 0.08604325
[2,] -0.02821313 -0.04864740 0.126741901 -0.04291559 0.11151189
[3,]  0.03416084  0.09956368 0.033908106  0.15106946 0.04633017
          [,381]      [,382]      [,383]      [,384]     [,385]
[1,]  0.01628662 -0.03175199 -0.04446435  0.03977022 0.00684654
[2,]  0.01081612  0.06446750 -0.06379179  0.07895180 0.21498598
[3,] -0.02309628  0.15620320 -0.16393524 -0.02805457 0.10082961
         [,386]      [,387]        [,388]      [,389]       [,390]
[1,] -0.0878603 -0.02482706  0.0805845782  0.26570842  0.002137563
[2,] -0.1599482  0.05167207 -0.0001966804 -0.03986673 -0.032002259
[3,] -0.1875746 -0.06778778  0.0429068431 -0.01857018  0.001538424
           [,391]     [,392]     [,393]      [,394]      [,395]
[1,] -0.008382283 0.04031271  0.1503319 -0.15207227 0.016287033
[2,] -0.099398069 0.08796118 -0.0818783  0.01025959 0.039604645
[3,]  0.005648589 0.01951103 -0.1348186  0.03933498 0.005619545
          [,396]     [,397]      [,398]      [,399]       [,400]
[1,]  0.05844205 0.04118289 -0.17063127  0.11593033  0.003098754
[2,] -0.01318270 0.10266561 -0.17282510  0.13746029 -0.063525043
[3,] -0.05150577 0.08933778  0.06263008 -0.04378749 -0.056211594
         [,401]      [,402]      [,403]      [,404]      [,405]
[1,] 0.05415037 0.011254997 -0.08021654 -0.09940901  0.01778377
[2,] 0.11264771 0.035782840 -0.01895163  0.09955842 -0.05323046
[3,] 0.03951793 0.004913725 -0.03601250  0.09817193 -0.03813793
          [,406]      [,407]      [,408]      [,409]       [,410]
[1,]  0.11230858 -0.09613845 -0.01305507  0.12205683 -0.037554771
[2,] -0.02192646 -0.21035673 -0.03902277 -0.14837089 -0.102020487
[3,]  0.03404685  0.04706251  0.01461852 -0.01263856  0.008175315
          [,411]      [,412]      [,413]      [,414]      [,415]
[1,] -0.04531926  0.03520882  0.11528349  0.05115390 -0.01917591
[2,] -0.04315428  0.08763956  0.01078005  0.05163160 -0.14459552
[3,]  0.01963619 -0.03415635 -0.05583279 -0.04368478 -0.07436517
           [,416]      [,417]      [,418]     [,419]     [,420]
[1,] -0.014584796 0.003684893 -0.05642702 -0.1454906 -0.1043315
[2,] -0.101387501 0.009382152 -0.11377819 -0.2054397 -0.1259652
[3,] -0.003488383 0.001876917 -0.16105342 -0.1437402 -0.1187559
          [,421]      [,422]      [,423]      [,424]    [,425]
[1,] -0.17035030  0.01960437  0.05055789 -0.18750297 0.1078800
[2,] -0.09877777 -0.03259879 -0.06047024 -0.04328201 0.1905506
[3,] -0.12347282 -0.05843275  0.02038978 -0.12298420 0.1448566
          [,426]      [,427]      [,428]     [,429]       [,430]
[1,] -0.01809759  0.07016796 -0.02551789 -0.0282625 -0.126578495
[2,]  0.06140823 -0.01092621  0.05080711 -0.1517675 -0.095688693
[3,]  0.02115142  0.05863923 -0.03656304 -0.1759150 -0.003724739
           [,431]      [,432]      [,433]      [,434]      [,435]
[1,] -0.132467195  0.02622927 -0.03123109 -0.03247021 -0.08306324
[2,]  0.006821066  0.10227088 -0.08569778 -0.03584000 -0.12596449
[3,] -0.044484649 -0.01938494  0.01647643 -0.07612883 -0.11722742
          [,436]       [,437]      [,438]       [,439]      [,440]
[1,]  0.05341662  0.008125714  0.01058675  0.003382702 -0.04252245
[2,] -0.03659999 -0.019274060 -0.02988921 -0.003417473 -0.07552858
[3,] -0.13190494 -0.101536736 -0.01074645  0.069811776 -0.12404119
          [,441]      [,442]     [,443]      [,444]       [,445]
[1,] -0.07372800 -0.05849045 0.03524964  0.16877052  0.068114609
[2,]  0.08032336  0.01231460 0.06118907 -0.01793814  0.005942287
[3,]  0.06018349  0.02405287 0.12663981 -0.21619299 -0.003959647
          [,446]      [,447]     [,448]       [,449]     [,450]
[1,]  0.07226302 -0.28510937 0.02432721 -0.002935223 0.12678717
[2,] -0.04607016  0.03129927 0.04820821 -0.023311311 0.04368496
[3,] -0.02281588 -0.16155379 0.11851458  0.048239492 0.04805805
         [,451]       [,452]       [,453]    [,454]      [,455]
[1,]  0.1290212  0.045280058  0.009119998 -1.274157  0.08619729
[2,]  0.0715922 -0.005440829 -0.144796416 -1.462837  0.01355328
[3,] -0.1276753  0.029364327 -0.193132773 -1.059171 -0.05841826
          [,456]     [,457]      [,458]      [,459]    [,460]
[1,] -0.02242112 0.12967354 -0.01173547 -0.03486820 0.1541892
[2,] -0.01034332 0.05542339  0.10062410 -0.04629513 0.1058829
[3,]  0.07782142 0.05496720  0.05659538 -0.03782411 0.1209047
          [,461]      [,462]     [,463]       [,464]     [,465]
[1,] -0.02452869 -0.04038483 0.06677143 -0.015628178 0.06511339
[2,]  0.01132475 -0.08882064 0.01159206  0.001231097 0.06531174
[3,] -0.05360979 -0.05398347 0.01270098 -0.074746877 0.01321395
         [,466]     [,467]       [,468]      [,469]      [,470]
[1,] -0.1577305 0.03123928  0.070899189 -0.03319991  0.03282479
[2,] -0.1554452 0.01563417 -0.001428645  0.02413461  0.03101723
[3,] -0.1477797 0.02752027  0.007906511  0.10748497 -0.00635145
         [,471]       [,472]       [,473]     [,474]     [,475]
[1,] 0.16071421 -0.125148043 -0.100893088 -0.1231603 0.14092636
[2,] 0.17233622 -0.008775132  0.053332336 -0.2380183 0.12693952
[3,] 0.08292822  0.026071273  0.002210962 -0.1546290 0.04061038
          [,476]     [,477]     [,478]      [,479]     [,480]
[1,] -0.03535345 0.13054915 0.15377441 -0.01675398 0.08626701
[2,] -0.04771874 0.07086749 0.10664982 -0.10120071 0.06549369
[3,]  0.02360129 0.03611998 0.02511051  0.10376409 0.02557622
         [,481]       [,482]     [,483]       [,484]       [,485]
[1,] 0.05674988  0.001078123 0.04609403 -0.026389971 -0.001271373
[2,] 0.02827371 -0.029098878 0.14548145 -0.004448816  0.029100453
[3,] 0.04148384 -0.008389830 0.01104456  0.070395663  0.001577110
          [,486]      [,487]        [,488]     [,489]      [,490]
[1,]  0.03562701 0.049074814 -0.0618827790 0.20455712 -0.04610657
[2,]  0.04760998 0.005309679  0.0760122985 0.05616186 -0.04608857
[3,] -0.07649758 0.091375560  0.0004809797 0.19519871 -0.03994152
         [,491]       [,492]     [,493]     [,494]    [,495]
[1,] 0.07703701  0.007839035 0.10319084 0.03121312 0.1747248
[2,] 0.18174568 -0.029557465 0.09673726 0.11808877 0.1730784
[3,] 0.04589190 -0.154339537 0.18160686 0.08215430 0.1830094
         [,496]     [,497]      [,498]     [,499]       [,500]
[1,] 0.04601399 -0.3952856  0.13922954 0.02999381  0.053702738
[2,] 0.05933195 -0.2772395 -0.01966263 0.33181602 -0.004030934
[3,] 0.10112993 -0.3435352 -0.02424987 0.25223950  0.046554431
          [,501]      [,502]      [,503]      [,504]      [,505]
[1,] -0.02336188 -0.01022422  0.13448614 -0.01043796  0.05471098
[2,] -0.04218457  0.05461446 -0.04669698 -0.02909032  0.03523045
[3,] -0.05676673  0.17867416  0.07421271  0.05624302 -0.01802966
          [,506]      [,507]      [,508]       [,509]      [,510]
[1,]  0.24928488 -0.06591306 -0.05561115 0.0006714305 0.054474905
[2,]  0.11431139 -0.07981958 -0.02691508 0.0866740122 0.005401139
[3,] -0.00323073 -0.05142399 -0.02943678 0.2296749055 0.023786074
           [,511]      [,512]      [,513]      [,514]       [,515]
[1,]  0.002875101 -0.05484245 0.122998923 -0.03010709 -0.030595267
[2,]  0.053738769  0.11779324 0.007506833  0.03718942  0.122838140
[3,] -0.055321712 -0.02580264 0.081575297  0.02921003  0.007531753
          [,516]       [,517]       [,518]      [,519]     [,520]
[1,] -0.12877816 -0.099791571  0.032153402 -0.01484757 0.01290180
[2,]  0.03527739 -0.092365213  0.043330155 -0.18486373 0.00277519
[3,]  0.09122708 -0.001451677 -0.001876002 -0.10912811 0.02595762
           [,521]     [,522]        [,523]      [,524]      [,525]
[1,] -0.013234006 0.07565649 -0.0802963227  0.09339714 -0.06817224
[2,] -0.005343141 0.02226268 -0.0694348067 -0.01199249 -0.05812830
[3,] -0.041063350 0.03402158 -0.0004286381 -0.10582599 -0.04330410
          [,526]       [,527]      [,528]     [,529]      [,530]
[1,]  0.06233599 -0.058382995 -0.01924860 0.04489377  0.06559096
[2,] -0.03440321  0.007027936  0.09098544 0.12303372 -0.10185946
[3,]  0.00528050 -0.018891983  0.02801421 0.09198729 -0.10712181
         [,531]       [,532]     [,533]        [,534]     [,535]
[1,] 0.14161345 -0.174752995 0.06227533  0.0662514269 -0.2177512
[2,] 0.07809762  0.121065632 0.17180447 -0.0007127949 -0.1000329
[3,] 0.26621985 -0.003991501 0.11837573  0.0913059711 -0.1121633
           [,536]       [,537]      [,538]       [,539]       [,540]
[1,] 0.1329743713  0.203391671 0.005818313 -0.024657749  0.100481018
[2,] 0.0004924695  0.032354366 0.092214897  0.002023025 -0.009617069
[3,] 0.1128094494 -0.004464632 0.065579392  0.203502029  0.011754591
          [,541]     [,542]      [,543]       [,544]     [,545]
[1,]  0.06165432 0.06411295 -0.01389637  0.004815212 0.09737331
[2,] -0.31385234 0.07329942 -0.03446046 -0.010144308 0.16229889
[3,] -0.15213887 0.10936663  0.12071300  0.045249429 0.14473276
         [,546]      [,547]      [,548]     [,549]      [,550]
[1,] 0.10238507 -0.04129021 -0.10708246 0.10174325  0.20909365
[2,] 0.07931236  0.14736558 -0.09683255 0.06213352  0.04103754
[3,] 0.08468400  0.13924018 -0.16481984 0.10367008 -0.10729636
            [,551]      [,552]      [,553]     [,554]        [,555]
[1,]  0.0624070317 -0.61854422  0.04605782 0.14104550  0.0380168185
[2,]  0.0001775564 -0.08443949  0.01284193 0.04988941 -0.0070983134
[3,] -0.0473435894 -0.22047752 -0.10745245 0.03003494 -0.0004632226
           [,556]      [,557]     [,558]       [,559]       [,560]
[1,]  0.081258409 -0.02223173 0.14613253 -0.008433553  0.003069871
[2,] -0.005587024  0.06710502 0.04002861 -0.115116470 -0.009286086
[3,] -0.016599791  0.07533991 0.01688313 -0.062957704  0.125670001
           [,561]      [,562]       [,563]     [,564]      [,565]
[1,] -0.077496365  0.07959890 -0.044659276 0.09971232  0.19913223
[2,] -0.064988703 -0.26414856  0.012861216 0.04657340 -0.06462403
[3,] -0.005218811  0.05580022 -0.006904415 0.02663442 -0.01509167
          [,566]      [,567]      [,568]    [,569]     [,570]
[1,] 0.114193216 -0.01769557 -0.05894598 0.0364887 0.06750645
[2,] 0.004687837  0.16266641  0.12134925 0.1508602 0.09792332
[3,] 0.026070904  0.06955954  0.09051076 0.2009770 0.06939902
        [,571]      [,572]     [,573]      [,574]      [,575]
[1,] 0.1354541  0.03108129 -0.1254772  0.09168441 -0.03282591
[2,] 0.3937585  0.03401157 -0.1821007 -0.09378675  0.06853189
[3,] 0.2023968 -0.01192953 -0.1219219  0.04055867  0.08656785
         [,576]     [,577]     [,578]       [,579]      [,580]
[1,] 0.02814430 0.02949820 0.08399966  0.002397518 -0.01157259
[2,] 0.03997610 0.04344099 0.05165761 -0.106884822  0.14118411
[3,] 0.04757469 0.08710670 0.12816823 -0.140741035  0.09758914
          [,581]       [,582]      [,583]     [,584]     [,585]
[1,] -0.02753787  0.001775346 -0.03254072 0.07128654 0.01661594
[2,]  0.04450496 -0.064209178 -0.03106757 0.10829566 0.04823763
[3,] -0.01151269  0.017413810  0.01344837 0.16895512 0.06729863
        [,586]       [,587]       [,588]   [,589]       [,590]
[1,] 0.1588211 -0.057526991  0.164113939 10.90037  0.006117357
[2,] 0.3630488  0.006175421 -0.022398140 11.46694 -0.026343763
[3,] 0.1494202 -0.146993756 -0.004960514 10.94750  0.002871577
          [,591]     [,592]     [,593]      [,594]     [,595]
[1,] -0.03501413 0.09018756 0.09292749  0.06452341 0.09570796
[2,] -0.01308394 0.12172861 0.12719628 -0.04230946 0.01630062
[3,]  0.02746754 0.05904661 0.10432360  0.01748843 0.06194986
         [,596]       [,597]     [,598]      [,599]      [,600]
[1,] -0.1245510  0.126792595 0.08956464  0.04358978  0.06552735
[2,] -0.1412971  0.068248354 0.10850821 -0.05155482 -0.03458041
[3,] -0.1030471 -0.008065663 0.16562979 -0.04389632  0.01321192
          [,601]      [,602]       [,603]       [,604]     [,605]
[1,]  0.07334094 -0.14853717 -0.049167056 -0.025061384 -0.2480717
[2,] -0.10552808 -0.01617761  0.003674608 -0.039574828 -0.2337332
[3,] -0.05090923 -0.18733242  0.033544432 -0.002467056 -0.2309394
          [,606]      [,607]     [,608]      [,609]       [,610]
[1,]  0.05167240 -0.06212182 0.03001972 -0.00619802  0.007160423
[2,] -0.01576734  0.06934274 0.05146546  0.10603949 -0.086451992
[3,] -0.03427850 -0.03544147 0.01841952  0.02314705  0.022775982
          [,611]    [,612]      [,613]     [,614]    [,615]
[1,] -0.05672626 0.4887470 -0.09061193 0.02761512 0.1753153
[2,] -0.03457374 0.3132913 -0.06518495 0.07075723 0.1365166
[3,]  0.05754312 0.2122859 -0.16194762 0.09791545 0.1323497
           [,616]      [,617]     [,618]       [,619]       [,620]
[1,] -0.073208764 -0.04377925 -0.2182470  0.086536877 -0.003400031
[2,] -0.040997539 -0.09075450  0.1293170  0.057046954 -0.022099968
[3,]  0.007723839 -0.08163230  0.1922674 -0.003527197  0.028169820
          [,621]       [,622]    [,623]    [,624]      [,625]
[1,] -0.08855677 -0.039544635 0.2913368 0.1970724  0.13446003
[2,] -0.02975615 -0.002721837 0.1388374 0.1549672 -0.11485711
[3,]  0.02392290 -0.021772724 0.2180016 0.2168985 -0.08745814
          [,626]     [,627]      [,628]      [,629]      [,630]
[1,] 0.025623247 0.02731249  0.09582750 0.165652469  0.09727748
[2,] 0.039845135 0.02735314 -0.03477661 0.004500133 -0.01256608
[3,] 0.003514442 0.01346861  0.08918107 0.032330044 -0.02128103
         [,631]     [,632]       [,633]         [,634]    [,635]
[1,] 0.09574559 0.05824444  0.026450677 0.000007026363 0.1319726
[2,] 0.05082534 0.03188763 -0.044073578 0.045933425426 0.1515071
[3,] 0.05104866 0.02088815 -0.009409678 0.131420865655 0.1152052
         [,636]      [,637]      [,638]       [,639]      [,640]
[1,] 0.11872996  0.06740426 -0.03295327  0.005091864  0.07032682
[2,] 0.06416409  0.03777796  0.02751510  0.095414653 -0.02035147
[3,] 0.17874897 -0.01981001  0.06767552 -0.010958292  0.01296261
         [,641]     [,642]       [,643]     [,644]         [,645]
[1,] 0.06485382 0.10023060 -0.037353795 0.05855997 -0.04702448472
[2,] 0.05736234 0.02852193  0.005037601 0.02233046  0.03281811997
[3,] 0.18294042 0.28169319  0.029283861 0.04694387  0.00003481098
          [,646]      [,647]     [,648]      [,649]      [,650]
[1,] 0.014599899  0.05295621 -0.2318424 -0.03862790  0.06915803
[2,] 0.002245907 -0.07289909 -0.2497116 -0.05421761 -0.05715271
[3,] 0.017213577 -0.04228573 -0.2032288 -0.02221883  0.09396903
           [,651]      [,652]      [,653]      [,654]     [,655]
[1,] -0.008573882  0.13817659  0.11774102 0.007180711 0.01153503
[2,]  0.029099595 -0.07085797 -0.39698678 0.020039564 0.02389313
[3,]  0.048816685  0.11434027  0.09909724 0.011828766 0.06005841
         [,656]     [,657]     [,658]       [,659]       [,660]
[1,] 0.16323003 -0.2821815 0.08282419  0.005385381 -0.080821373
[2,] 0.02120099 -0.1751777 0.01142891 -0.157813326 -0.007341859
[3,] 0.02138077 -0.2424365 0.07629174 -0.090664104 -0.010929093
          [,661]      [,662]      [,663]       [,664]     [,665]
[1,] -0.05973516 -0.05402818  0.05043638 -0.053119019 -0.4382347
[2,] -0.03607860  0.09529447  0.12802537 -0.027307253 -0.1644347
[3,] -0.09080776  0.07575031 -0.03847428 -0.002830364 -0.2158440
           [,666]      [,667]      [,668]      [,669]      [,670]
[1,]  0.127558082 -0.10169803 -0.06219704 -0.02747761 -0.01329563
[2,] -0.009646388  0.07948887 -0.23120938 -0.03643456  0.04320972
[3,] -0.021814600 -0.07878051 -0.23047507  0.03719737  0.03053882
          [,671]      [,672]      [,673]       [,674]      [,675]
[1,]  0.01891686 -0.12061667  0.32487297 -0.005448162 0.006524894
[2,] -0.06934149  0.01744718  0.09623934  0.009026065 0.225343466
[3,]  0.14336102  0.07816807 -0.10652222  0.047874715 0.168353990
        [,676]       [,677]      [,678]       [,679]     [,680]
[1,] 0.0451108  0.124926098 -0.06043627  0.003482156 0.13969089
[2,] 0.1218993 -0.030079177 -0.03301956 -0.047115240 0.10056076
[3,] 0.1264632  0.004649751 -0.02930072  0.053336959 0.02692399
         [,681]       [,682]   [,683]      [,684]     [,685]
[1,] 0.04883071  0.006217855 0.105628 -0.03514947  0.1576692
[2,] 0.15232715 -0.054866929 0.146859 -0.07151469  0.1043521
[3,] 0.20380823 -0.171182945 0.048924 -0.06596526 -0.1094459
          [,686]    [,687]      [,688]     [,689]      [,690]
[1,] -0.13343440 0.1150668  0.04277812 -0.1700584 -0.08152786
[2,] -0.02560283 0.1137769 -0.13468525 -0.0432230  0.09222019
[3,] -0.11482394 0.1435495  0.07105525 -0.0952179 -0.02150658
          [,691]      [,692]       [,693]      [,694]      [,695]
[1,] 0.001460104 -0.02684199  0.159551024  0.01701519 -0.17243104
[2,] 0.076190174  0.04345487  0.122259133  0.04309671 -0.04582918
[3,] 0.076813765  0.07290456 -0.009004088 -0.02147820 -0.05113938
          [,696]      [,697]      [,698]      [,699]      [,700]
[1,] 0.071569681  0.01079237 -0.06372253  0.03304843 -0.02441823
[2,] 0.061498780 -0.07271672  0.08297615 -0.09365286 -0.09535123
[3,] 0.008571736  0.06767070  0.04084178  0.01795634  0.01589342
          [,701]       [,702]      [,703]      [,704]     [,705]
[1,] 0.051343724  0.017095907  0.08447219  0.01810732 0.03884545
[2,] 0.003084684  0.002061225 -0.04824588 -0.06848171 0.02627856
[3,] 0.019820197 -0.030093983 -0.02302835 -0.07308745 0.01341599
          [,706]      [,707]       [,708]      [,709]     [,710]
[1,]  0.02292803 -0.02241533 -0.005699741 -0.14785856 0.06368943
[2,]  0.02831715 -0.02251743  0.113158464 -0.09536365 0.12465273
[3,] -0.02921605 -0.03969850  0.140876904 -0.07692195 0.03233643
          [,711]      [,712]       [,713]      [,714]      [,715]
[1,] -0.03690190 0.093571730 -0.004948105  0.04304661 -0.01409842
[2,] -0.11779904 0.008528029  0.011699425 -0.04191633  0.13354866
[3,] -0.06761794 0.038781248 -0.031239903 -0.03373789  0.05055318
           [,716]      [,717]      [,718]      [,719]     [,720]
[1,] -0.044394851 -0.01228573 0.004501287  0.03997793 0.11182661
[2,] -0.005906425 -0.07271305 0.073141493 -0.12115751 0.06879991
[3,] -0.086893030 -0.07782221 0.092925116 -0.09501198 0.03865187
          [,721]     [,722]     [,723]       [,724]      [,725]
[1,]  0.16200098 -0.1963276 0.07506953  0.108284950  0.06242521
[2,]  0.07843442 -0.0272484 0.09158851 -0.045756642 -0.03038417
[3,] -0.16206633 -0.0492104 0.11310261 -0.001868449 -0.05736248
         [,726]      [,727]       [,728]      [,729]       [,730]
[1,] 0.06534697  0.02324181  0.010514254  0.05806167 -0.002928009
[2,] 0.04052048 -0.23091494 -0.006549641 -0.03614023 -0.163491592
[3,] 0.04237001 -0.14198439  0.101073012  0.03866592 -0.154501140
          [,731]     [,732]       [,733]      [,734]       [,735]
[1,] -0.07826689 -0.4306147  0.034221351 -0.06769373  0.023430072
[2,]  0.01333705 -0.4634736  0.003700569 -0.04821631  0.003874643
[3,]  0.07550879 -0.5461201 -0.050262697 -0.24380949 -0.072438218
         [,736]      [,737]       [,738]        [,739]      [,740]
[1,] -0.1128417 -0.01578417 -0.099718347 -0.0455011204 -0.10483529
[2,]  0.2115270  0.04394335  0.007121652  0.0004530831 -0.08130268
[3,]  0.1422799  0.06445334  0.084635690  0.0257632788 -0.05460403
         [,741]      [,742]     [,743]      [,744]       [,745]
[1,] 0.14446807  0.03796916 0.06176548 -0.02199821  0.007535934
[2,] 0.13209458 -0.11759082 0.11235521  0.03373785 -0.042034440
[3,] 0.09626281 -0.29080799 0.11512416  0.07427175 -0.164961562
        [,746]      [,747]      [,748]      [,749]     [,750]
[1,] 0.1538259 -0.02231905  0.08385108 -0.09496891 -0.3132910
[2,] 0.1086871  0.02552897 -0.07375989 -0.10328012 -0.2329280
[3,] 0.1080883  0.02716528 -0.08429061  0.13082039 -0.1498961
         [,751]      [,752]      [,753]     [,754]      [,755]
[1,] 0.13544297 -0.09229933 0.006370207 0.10247675 -0.01745539
[2,] 0.07169295 -0.11198869 0.277260184 0.07255528  0.01768901
[3,] 0.09499805 -0.12241976 0.367802501 0.06684625  0.10543489
         [,756]      [,757]      [,758]      [,759]     [,760]
[1,] 0.05288321  0.09733097  0.06987759 -0.19151534 0.06136052
[2,] 0.02264082 -0.05838012 -0.06376933 -0.10843939 0.06910763
[3,] 0.22303495 -0.04375997 -0.15094276 -0.06138091 0.03490181
          [,761]      [,762]      [,763]     [,764]    [,765]
[1,] -0.03410539 -0.01715597  0.08264564 0.16676839 0.1246100
[2,] -0.11565023 -0.06192952  0.02285620 0.02905226 0.3959301
[3,]  0.04694730 -0.07533912 -0.08235338 0.10327009 0.2405042
        [,766]      [,767]      [,768]
[1,] 0.1230820 -0.01121444  0.03752019
[2,] 0.1823843  0.05410477 -0.13935684
[3,] 0.1092856  0.06907135 -0.12155339

3. Generating sentence embeddings for the CommonLit Readability dataset

In summary, NLP models may provide meaningful contextual numerical representations of words or sentences. These numerical representations can be used as input features for predictive models to predict a particular outcome. In our case, we can generate the embeddings for each reading passage. In the coming weeks, we will use them to predict the target score using various prediction algorithms.

First, we will check the length of the reading excerpts in the dataset.

sentence_length <- nchar(readability$excerpt)

summary(sentence_length)
   Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
  669.0   886.0   972.0   972.6  1059.0  1343.0 

The number of characters ranges from 669 to 1343. In this case, I want to use a model that can handle long texts. For instance, RoBERTa would ignore any text after the first 512 characters in a reading excerpt, and we may lose some vital information regarding the outcome.

An alternative model to process longer texts is the Longformer model. The Hugging Face page for this model is https://huggingface.co/allenai/longformer-base-4096.

Let’s load this model as we did for RoBERTa.

model.name <- 'allenai/longformer-base-4096'

longformer      <- st$models$Transformer(model.name)
pooling_model   <- st$models$Pooling(longformer$get_word_embedding_dimension())
LFmodel         <- st$SentenceTransformer(modules = list(longformer,pooling_model))

This model can handle texts up to 4096 characters, and returns a vector of length 768.

LFmodel$get_max_seq_length()
[1] 4096
LFmodel$get_sentence_embedding_dimension()
[1] 768

Now, we can submit the reading excerpts from our dataset all at once, and get the sentence embeddings for each one. Since our dataset has 2834 observations, this should return a matrix with 2834 rows and 768 columns.

read.embeddings <- LFmodel$encode(readability$excerpt,
                                  show_progress_bar = TRUE)
# Check the embedding matrix

dim(read.embeddings)
[1] 2834  768
head(read.embeddings)
           [,1]        [,2]          [,3]        [,4]       [,5]
[1,] 0.06878642  0.02737294  0.0353682041 -0.17769572 0.17525391
[2,] 0.06200736  0.18268286  0.0024652195 -0.10744876 0.51925117
[3,] 0.02648670  0.09453232  0.0296205040 -0.06081667 0.25797406
[4,] 0.04218233  0.03943034 -0.0004737412 -0.22149815 0.16781905
[5,] 0.01741268  0.11062079  0.0012940745 -0.30953035 0.27908468
[6,] 0.03088607 -0.01201622  0.1024196073 -0.04266621 0.08677045
             [,6]         [,7]        [,8]        [,9]        [,10]
[1,] -0.062003829 -0.009241561  0.18663073 -0.08267820  0.050396595
[2,] -0.009631317  0.021055585  0.10391098 -0.12528235  0.120555066
[3,] -0.026006516  0.010462754  0.07656582 -0.05405279  0.043316741
[4,] -0.130812421 -0.001381062  0.17187740  0.02726705  0.100796096
[5,]  0.201777592 -0.169042930  0.17893136  0.07310306 -0.053442664
[6,] -0.099492773 -0.007720584 -0.03680542 -0.08005710 -0.002916175
           [,11]       [,12]      [,13]       [,14]      [,15]
[1,] -0.08924759 -0.12584847 0.07532627 -0.09043550 0.16977578
[2,] -0.12325408 -0.03490974 0.05919705 -0.07151967 0.06679756
[3,] -0.12445029  0.01071901 0.05318572  0.01152111 0.06358113
[4,] -0.01702231 -0.05677414 0.08501364  0.08951008 0.02121747
[5,] -0.08641744 -0.05077145 0.16863522  0.06391545 0.09241463
[6,] -0.10258079 -0.08562840 0.05569165  0.10128744 0.10752373
          [,16]     [,17]        [,18]       [,19]       [,20]
[1,] 0.06627524 0.1254534  0.149795040 -0.09539226 -0.05386250
[2,] 0.06315146 0.1181628 -0.172043473 -0.10171498  0.08964073
[3,] 0.08248881 0.1091467 -0.076039344 -0.12442163  0.13084817
[4,] 0.21985857 0.2758147  0.066664048 -0.01095178  0.11738628
[5,] 0.06473929 0.1145013  0.026287500 -0.16021247 -0.03594755
[6,] 0.03598172 0.3445779  0.008862211 -0.03162296  0.06223473
            [,21]      [,22]        [,23]       [,24]         [,25]
[1,]  0.019800426 0.05689066 -0.066817492 -0.01374022 -0.0005434537
[2,] -0.033529568 0.09369566  0.005841169 -0.12309865 -0.0396644436
[3,] -0.003348924 0.08551493  0.096154064 -0.04318059 -0.0134544317
[4,]  0.047499601 0.01420696 -0.059058707 -0.06542822  0.0618643127
[5,]  0.011399466 0.15386474 -0.157574072  0.12298665 -0.0167587493
[6,]  0.068682052 0.07682541  0.009790933 -0.09392697  0.0859657153
             [,26]      [,27]     [,28]       [,29]      [,30]
[1,] -0.0398280062 0.06324669 0.1239742  0.05714065 -0.0784037
[2,]  0.0007338378 0.16816032 0.1769400  0.14561471 -0.1236172
[3,]  0.0233391654 0.09676986 0.1174871  0.16839454 -0.1228397
[4,]  0.0026793315 0.05301249 0.1669814  0.03192727 -0.2018328
[5,]  0.0843952000 0.24310870 0.2146871  0.04003200 -0.1260741
[6,] -0.0813994482 0.17552009 0.1065100 -0.05466254 -0.1454486
           [,31]        [,32]        [,33]      [,34]       [,35]
[1,] -0.05841080  0.009110089  0.078652218 0.10221330 -0.10459986
[2,] -0.04242602  0.069912344  0.057975896 0.03614431 -0.18198293
[3,] -0.05578281  0.075226575  0.023002410 0.04269278 -0.05390055
[4,] -0.00404502 -0.018618550  0.001835824 0.06220116 -0.03155796
[5,] -0.20792694 -0.103156604 -0.026916955 0.07625656  0.05396373
[6,] -0.07710957  0.064506762  0.057588067 0.05781943  0.01271113
           [,36]        [,37]       [,38]     [,39]       [,40]
[1,]  0.02391223  0.110306241 0.043328114 0.4521784  0.03735125
[2,]  0.04250664 -0.009082338 0.007062219 0.4343244  0.06531474
[3,]  0.01181644  0.005166513 0.011582398 0.3327737  0.09386559
[4,] -0.05737976  0.074416302 0.015505768 0.5607200 -0.03983847
[5,] -0.01515435  0.076285161 0.131026924 0.4974277  0.03435208
[6,] -0.01635659  0.006289245 0.023226904 0.3060058  0.05415952
           [,41]      [,42]       [,43]        [,44]       [,45]
[1,]  0.01160207 -0.1441056 -0.06634481  0.013188138 -0.03034872
[2,] -0.09629171 -0.2475861 -0.06511805  0.029367110 -0.02183991
[3,] -0.08046697 -0.1241342 -0.07358038  0.041240882 -0.01687782
[4,]  0.02450111 -0.1278276 -0.04889721 -0.058667518 -0.04264880
[5,] -0.04384707 -0.1287246 -0.06949089  0.075815417 -0.04147740
[6,] -0.03843844 -0.2790852 -0.07422113  0.003265372  0.01405668
           [,46]       [,47]       [,48]         [,49]       [,50]
[1,]  0.05563493 -0.12030786  0.17755996 -0.0009431239  0.02273739
[2,] -0.00349074 -0.25071853  0.11311000  0.0546880662  0.04223915
[3,] -0.03969015 -0.16227439  0.17778057  0.0135517670 -0.02265750
[4,]  0.01296046 -0.01586921  0.20198743 -0.0287195258 -0.02992338
[5,]  0.10140187 -0.21261519 -0.04230785 -0.0213186536  0.01532555
[6,]  0.05705843 -0.21435523  0.14221516  0.0081882812  0.06091512
            [,51]       [,52]         [,53]       [,54]       [,55]
[1,] -0.055851076 0.045075454  0.0457919426  0.01860519 -0.04628744
[2,]  0.028229486 0.145248696  0.0022057290  0.02396804 -0.08741326
[3,]  0.013225293 0.138259456  0.0169651713  0.01428844 -0.09812585
[4,]  0.009362207 0.009168806 -0.0189137459 -0.07263523 -0.05096374
[5,] -0.054614712 0.016204031  0.0061255246  0.01164986 -0.12076854
[6,] -0.046974260 0.004813397  0.0006372099 -0.02829496 -0.07158546
          [,56]      [,57]       [,58]      [,59]       [,60]
[1,] 0.11621416 0.19029057 -0.18323594 0.15596573 -0.16865835
[2,] 0.15194535 0.07216028  0.19703192 0.03920581 -0.05542378
[3,] 0.05171975 0.07081036  0.16018121 0.07730552 -0.12761781
[4,] 0.06082216 0.14776467  0.06345271 0.16414967 -0.11517348
[5,] 0.06762488 0.09770873 -0.06482673 0.05881982 -0.18440580
[6,] 0.18844305 0.15123229  0.03043088 0.07150017 -0.06692398
           [,61]       [,62]       [,63]      [,64]        [,65]
[1,] -0.01584120 -0.30836877 -0.08627234 0.05220238 -0.073660202
[2,]  0.09358547 -0.12590311 -0.01988886 0.15112427 -0.057417575
[3,]  0.00353132 -0.02997617 -0.06488663 0.10850967  0.000176775
[4,]  0.07951759  0.01796308 -0.08190001 0.09804805 -0.032816716
[5,]  0.01957706  0.39047232 -0.16133040 0.22548598 -0.071758203
[6,]  0.05250159 -0.21743841 -0.03778880 0.11767841 -0.063424781
           [,66]      [,67]       [,68]        [,69]       [,70]
[1,] -0.09121702 0.06205500 -0.00664423  0.044466395  0.10872079
[2,] -0.06620028 0.02835573 -0.07774094  0.025311865  0.10251271
[3,] -0.08376483 0.08219867 -0.15987641  0.002131245  0.04943869
[4,] -0.10609961 0.01014323 -0.20266037  0.042984761  0.04320575
[5,] -0.12487545 0.05126919 -0.21430783 -0.032729916 -0.02177408
[6,] -0.12166830 0.08317646 -0.05596460  0.031021968  0.12048520
          [,71]      [,72]      [,73]       [,74]         [,75]
[1,] 0.05152616 -0.1286170 0.07124258 -0.13667069  0.0436399579
[2,] 0.11669674 -0.1081983 0.02155845  0.05324470  0.0256285314
[3,] 0.07750056 -0.1166162 0.03136687  0.08986921 -0.0002351542
[4,] 0.17135516 -0.1582801 0.02830557 -0.13921450  0.0152892377
[5,] 0.02453504 -0.2918184 0.01494434 -0.25516808  0.1191712022
[6,] 0.08055479 -0.1039434 0.03267877  0.08227553 -0.0112367412
           [,76]       [,77]     [,78]       [,79]        [,80]
[1,]  0.09222718 -0.02197541 -5.946264  0.14185232 -0.002517788
[2,]  0.02680033  0.01777905 -5.769702  0.13710310 -0.039606657
[3,]  0.12901822 -0.04005376 -5.613939  0.19400115 -0.007314286
[4,] -0.03612557  0.07990569 -5.738643  0.11591304 -0.004460549
[5,]  0.00174457 -0.01451725 -6.881078 -0.05151975 -0.024183193
[6,]  0.03638640 -0.05377566 -6.141560  0.12704419 -0.014760924
            [,81]      [,82]    [,83]       [,84]        [,85]
[1,]  0.041527856 0.09985719 1.121162  0.03830210 -0.063193858
[2,] -0.011150517 0.01501055 1.177877  0.01126669 -0.113686204
[3,] -0.007199855 0.02349413 1.150699  0.02726431 -0.095392525
[4,]  0.067316115 0.04642459 0.721678 -0.19776239  0.007204633
[5,]  0.026808724 0.08641411 1.250171  0.10575949 -0.082243785
[6,] -0.017409449 0.05579916 1.169361  0.05016227 -0.159839779
           [,86]      [,87]       [,88]       [,89]        [,90]
[1,] -0.26729175 0.07502843  0.13967815 -0.02483355  0.007648359
[2,] -0.03492378 0.01044415 -0.01767602  0.02817056 -0.012143429
[3,] -0.19305614 0.04591532  0.11847871  0.06890325  0.066408977
[4,] -0.24397978 0.12207813 -0.01864471 -0.09496449  0.026372869
[5,] -0.08974808 0.03191085  0.03928379  0.08986512  0.036878455
[6,] -0.11673717 0.01388938  0.02112357 -0.02177202  0.040249281
            [,91]      [,92]       [,93]     [,94]        [,95]
[1,]  0.085554458 0.07065610 -0.02443473 0.1472436  0.053917125
[2,]  0.005007802 0.07478565  0.01366426 0.1178765  0.090566173
[3,] -0.082261726 0.09630763  0.06820065 0.1347773 -0.003685075
[4,]  0.048539050 0.10452553 -0.03157165 0.1828313  0.032530654
[5,] -0.062374547 0.08127025 -0.05123742 0.3114559  0.083208121
[6,]  0.050125770 0.05533622  0.02127386 0.1706575  0.015914422
          [,96]        [,97]       [,98]       [,99]      [,100]
[1,] 0.20212734 -0.116203837  0.23486662 -0.02284844 -0.04338972
[2,] 0.06854723 -0.059805643  0.74454349  0.03837124  0.01315809
[3,] 0.16587275 -0.040862981  0.60500520  0.01118777 -0.08465243
[4,] 0.21602593 -0.042178612 -0.03365597 -0.01383332  0.02952261
[5,] 0.10416410 -0.110708982  0.45391500  0.07056663 -0.02640560
[6,] 0.05282875 -0.001121965  0.56108010  0.01365058 -0.03908147
          [,101]       [,102]     [,103]     [,104]      [,105]
[1,]  0.23872551  0.020933937 -0.2689151 0.15147276 -0.07147629
[2,]  0.15307951 -0.001722996 -0.2714304 0.03367482 -0.06458593
[3,] -0.04544293 -0.019447301 -0.1242545 0.19996431 -0.08332866
[4,]  0.09374914 -0.014098025 -0.2161348 0.16988960 -0.01689096
[5,]  0.46665555  0.075723723 -0.0992410 0.27997312 -0.11320364
[6,]  0.11137514  0.028680129 -0.2897870 0.04343583 -0.02774085
          [,106]       [,107]      [,108]      [,109]     [,110]
[1,] -0.10091496  0.007719000  0.14613576 -0.06393286 0.08753217
[2,] -0.09945138 -0.130645871 -0.04965333 -0.03176723 0.06711566
[3,] -0.06551234 -0.116697073  0.05235539 -0.05145445 0.02444218
[4,] -0.17506407  0.036558561  0.01593233 -0.06472807 0.13053261
[5,] -0.06535351 -0.009498350  0.08395107 -0.05001440 0.04134391
[6,] -0.14649561 -0.008850493  0.06866036 -0.06751941 0.05398743
         [,111]      [,112]      [,113]      [,114]      [,115]
[1,] 0.05948964  0.19408694 0.125716850  0.01159422 -0.07214574
[2,] 0.16257027 -0.05577020 0.044497672 -0.01349812 -0.07794671
[3,] 0.12493593  0.12674727 0.039884962 -0.02161937 -0.06567856
[4,] 0.02918692  0.12518449 0.006082227  0.06100188 -0.03282348
[5,] 0.09491364 -0.09426759 0.193379387  0.08677589 -0.13170332
[6,] 0.08426497  0.24839157 0.110648654  0.05496157 -0.13149224
          [,116]      [,117]       [,118]       [,119]      [,120]
[1,] -0.04729865 -0.01458118  0.007416536  0.015140262 -0.01364085
[2,]  0.09857436  0.05374681 -0.029883321 -0.006696742  0.11462778
[3,]  0.08839864 -0.01325786 -0.036843956  0.028005935 -0.02517148
[4,] -0.03490236  0.01637201 -0.026882786  0.002716305 -0.02008895
[5,]  0.01232459 -0.03626100  0.051883530 -0.022906721 -0.08221104
[6,] -0.06458402 -0.02047255 -0.006263990  0.064767666 -0.14237389
           [,121]     [,122]      [,123]      [,124]      [,125]
[1,] -0.029898381 0.13351487  0.03838781  0.12505446 0.277584553
[2,]  0.042145960 0.02854462 -0.03316170 -0.11165556 0.011946644
[3,]  0.052602947 0.06012842 -0.02576030  0.04977613 0.038049541
[4,] -0.032401364 0.11898023  0.11506625  0.04655128 0.011379799
[5,]  0.003823568 0.10826161  0.10774323  0.18962641 0.001085924
[6,] -0.001228545 0.12465001  0.02570309  0.06945270 0.124052927
          [,126]       [,127]      [,128]       [,129]       [,130]
[1,]  0.16553748 -0.045734782 -0.02095836 -0.028291635 -0.031091623
[2,]  0.07167397  0.007441618 -0.15562278 -0.063137099 -0.016863035
[3,]  0.03975507 -0.010778110 -0.09103153  0.004879553 -0.007059486
[4,]  0.05562349 -0.062935844  0.02984938 -0.104437672 -0.044301443
[5,]  0.06157386  0.007056880 -0.01511185 -0.088381991  0.057884976
[6,] -0.03435799 -0.035998534 -0.05777951 -0.017548744 -0.040689226
           [,131]      [,132]       [,133]      [,134]       [,135]
[1,] -0.068024397 -0.19685575 -0.057357501 -0.02150770  0.008344368
[2,] -0.127200842 -0.16465619 -0.030997569 -0.11230204 -0.059650008
[3,] -0.081564896 -0.02827076  0.002269247 -0.10395408  0.009244090
[4,] -0.107820205  0.22287221 -0.001476477 -0.06372286  0.015938897
[5,] -0.008750514 -0.12222122 -0.003253136  0.02914541  0.068772882
[6,] -0.103431627 -0.23775043  0.019290864 -0.02134318 -0.001622586
           [,136]      [,137]        [,138]      [,139]      [,140]
[1,] -0.102784194 -0.13495629  0.0142317209  0.02313250 -0.02105902
[2,] -0.075864702 -0.03264857  0.0236496422 -0.06827071  0.10808191
[3,]  0.001411123 -0.03584372 -0.0004037199 -0.05033645  0.08863413
[4,] -0.063902400 -0.11118698  0.0589230135  0.06679199  0.02210390
[5,] -0.093556628 -0.22081396  0.0001657894  0.01393972  0.12405545
[6,] -0.020176252 -0.13743046  0.0230124258  0.03991869  0.04353123
           [,141]       [,142]      [,143]       [,144]      [,145]
[1,]  0.088557333  0.040845133 -0.02909195 -0.024868179 -0.10013279
[2,]  0.009596834  0.078423120 -0.08343355  0.081874341 -0.13825487
[3,]  0.097992301  0.080675490  0.03624254  0.096607886 -0.05899038
[4,]  0.032477561  0.008287883  0.01552685 -0.093810037 -0.12003399
[5,] -0.045573782 -0.080180943  0.09660947 -0.003410187 -0.07613166
[6,]  0.052745692  0.069129847 -0.03849388 -0.013348532  0.05511277
          [,146]       [,147]      [,148]      [,149]     [,150]
[1,]  0.01643182  0.040502507 -0.05167877  0.02774313 0.09360757
[2,]  0.04458265 -0.047292855  0.02723607  0.03013752 0.16895996
[3,]  0.01492312  0.006588188 -0.04234581  0.03453827 0.03027742
[4,] -0.06132180  0.020900434 -0.03471314  0.01671150 0.07657420
[5,]  0.08212277 -0.040125243 -0.06929307 -0.00432986 0.05462028
[6,] -0.04039430  0.055167176 -0.15788952  0.02860752 0.15503193
           [,151]       [,152]      [,153]       [,154]       [,155]
[1,] -0.073861621  0.006610246 -0.07322597  0.004320241  0.079006694
[2,] -0.002897343 -0.032812975 -0.05331478  0.036128804  0.098519921
[3,] -0.061893009 -0.046659250 -0.06112369  0.034307890 -0.002737739
[4,] -0.004555190 -0.061745219 -0.05912172  0.062221162 -0.084972933
[5,] -0.023094578 -0.040132854  0.03313675 -0.009959953  0.055616483
[6,] -0.080483474 -0.080875732 -0.03731335  0.051242720 -0.007341798
        [,156]       [,157]    [,158]      [,159]    [,160]    [,161]
[1,] 0.1483632  0.008235849 0.1733116 -0.01954455 0.3793607 0.1087773
[2,] 0.2014366  0.067571804 0.3155718 -0.10236399 0.2850931 0.1659556
[3,] 0.1542511  0.003424891 0.2529557  0.03088392 0.2083622 0.1295714
[4,] 0.2362703 -0.027450442 0.2345958 -0.11995528 0.4174938 0.1058028
[5,] 0.1877714  0.063925140 0.2155312  0.08399600 0.5725406 0.1434436
[6,] 0.1657421  0.029531976 0.5287693 -0.01082900 0.2701406 0.1110887
          [,162]     [,163]      [,164]       [,165]     [,166]
[1,]  0.02382109 0.03934348 -0.07816513 -0.063273966 0.08881398
[2,]  0.05152238 0.05214351 -0.12706640 -0.132280082 0.16892013
[3,] -0.01791148 0.02596789 -0.12161267 -0.018316647 0.05279658
[4,] -0.09078024 0.06221739 -0.04423966  0.020219367 0.07977139
[5,]  0.01971423 0.07503922 -0.16571607 -0.160742879 0.23236096
[6,]  0.07012735 0.01299729 -0.14214301 -0.008776547 0.07046251
          [,167]      [,168]       [,169]       [,170]      [,171]
[1,]  0.11146063 -0.02742520  0.010782450  0.004686479 -0.04409403
[2,] -0.03822517  0.10706264 -0.017904045  0.010008985  0.04308533
[3,]  0.03960572  0.01006290  0.037345715 -0.020681502  0.02676369
[4,]  0.02204281  0.04992779  0.024536621  0.065638922 -0.06172321
[5,] -0.04216772 -0.05271583  0.015409810  0.044527601 -0.03895360
[6,]  0.15301870  0.09301525 -0.002569517  0.079733737  0.11045213
           [,172]       [,173]       [,174]       [,175]      [,176]
[1,] -0.030827977 -0.016552867 -0.037396442 -0.110546499  0.02091328
[2,] -0.118163362 -0.101622179  0.041260589  0.065143712 -0.00664208
[3,] -0.133316681 -0.062520601  0.000882378 -0.001258559 -0.04469740
[4,] -0.108924128 -0.029740350  0.044388141  0.034460146 -0.03467989
[5,]  0.009975387  0.009619499  0.066007525 -0.016155105  0.03704870
[6,] -0.122878514 -0.031314857  0.041082900 -0.014921487  0.04582291
          [,177]     [,178]      [,179]       [,180]      [,181]
[1,]  0.16406690 0.11637163 0.102757700 -0.065808818 -0.03085301
[2,]  0.23942780 0.12110980 0.192517295 -0.008136311 -0.11009263
[3,]  0.16348210 0.11496253 0.116396785 -0.053040501 -0.05610459
[4,] -0.01567582 0.13300121 0.143559024 -0.046972897 -0.06362554
[5,]  0.17504741 0.18193628 0.006118873  0.022498267  0.17850330
[6,]  0.21360956 0.02295497 0.114575908 -0.123433337 -0.03238666
           [,182]     [,183]       [,184]        [,185]      [,186]
[1,]  0.047487181 0.08365419 -0.006170089 -0.0099381404  0.02653007
[2,]  0.047892727 0.05988264 -0.101161323 -0.0003986875  0.08727922
[3,]  0.022679541 0.05163966  0.004005735  0.0242591817  0.08526003
[4,] -0.005437774 0.05755933 -0.108031176 -0.0605965853 -0.06346862
[5,]  0.024581207 0.04812210 -0.115264393 -0.0225114767  0.05047017
[6,]  0.102973312 0.10902948 -0.045517776  0.0117747318 -0.03072424
         [,187]      [,188]      [,189]       [,190]       [,191]
[1,] 0.15526831  0.07208288 -0.14248841  0.014994285 -0.011817173
[2,] 0.04445880 -0.02742394 -0.04661029  0.185127467  0.004467144
[3,] 0.07624952 -0.05811815 -0.06095228  0.085832350  0.029420679
[4,] 0.11060012  0.09253567 -0.11716639  0.112309471 -0.029765543
[5,] 0.14934652  0.03446966 -0.14601848  0.114642330 -0.031648837
[6,] 0.09348606 -0.02047507 -0.09198567 -0.005882796  0.044917762
        [,192]      [,193]    [,194]       [,195]       [,196]
[1,] 0.2376663  0.06471327 0.2869302  0.006595411 -0.002131236
[2,] 0.1286241  0.01402647 0.2060701  0.057511937  0.080612928
[3,] 0.1429217 -0.03414715 0.2847818  0.063547119  0.014086470
[4,] 0.1777786  0.06618749 0.2010641 -0.062344369  0.014133361
[5,] 0.2387890 -0.03502944 0.4510851  0.118920438  0.100134738
[6,] 0.2079677 -0.00836664 0.2252501  0.042308558 -0.035618603
           [,197]      [,198]      [,199]      [,200]      [,201]
[1,]  0.111284904  0.06065015  0.14765435 -0.09968079  0.05590762
[2,] -0.006094806 -0.04312481  0.07411973 -0.02219011  0.09446417
[3,] -0.026928667  0.03070987  0.10312929 -0.01123741  0.08575176
[4,]  0.064696468 -0.03691681  0.18689941 -0.02606682 -0.06948781
[5,]  0.116514213 -0.03425939 -0.10715778 -0.14326958 -0.04532622
[6,]  0.027877506  0.02917253  0.02128681 -0.02145256  0.09128784
           [,202]      [,203]      [,204]      [,205]       [,206]
[1,]  0.146735489  0.11358202 -0.08193325  0.25428578  0.065701984
[2,]  0.027812298  0.08971079 -0.02867646  0.00942719 -0.054258276
[3,] -0.046032969  0.02980055  0.01649122  0.17686845 -0.050942793
[4,]  0.123839982  0.02067737 -0.07756262  0.21948744  0.007775099
[5,] -0.008841063 -0.07333382 -0.08066885  0.35297471  0.064149112
[6,] -0.053674281 -0.09016324  0.03218077 -0.02127722  0.046199832
         [,207]       [,208]      [,209]      [,210]       [,211]
[1,] 0.01931344  0.055372115  0.01453709  0.02544891 -0.073285304
[2,] 0.06116709  0.009637616  0.03871655 -0.01346140  0.003739743
[3,] 0.12515076 -0.015982902  0.04348699  0.02505557 -0.025655473
[4,] 0.19800356  0.078355394 -0.02394519  0.01757303 -0.092073761
[5,] 0.18612207  0.150131032  0.03098740 -0.03294157 -0.097650550
[6,] 0.09481613  0.032243874  0.01760928  0.12533936 -0.021152314
         [,212]      [,213]      [,214]       [,215]        [,216]
[1,] 0.07963207 0.054734237 -0.01597461 -0.054342546 -0.0002604671
[2,] 0.17093231 0.108724132  0.22238894  0.014393425  0.0134764072
[3,] 0.15664001 0.028745873  0.18153188 -0.102613285  0.0280863140
[4,] 0.05071726 0.009211972  0.05590099 -0.109988436 -0.0181687865
[5,] 0.12925413 0.067303337  0.27411485 -0.153481498  0.0342940465
[6,] 0.14717685 0.034810364  0.18813257  0.009363505  0.0130624538
           [,217]      [,218]      [,219]     [,220]      [,221]
[1,] -0.058852341  0.12951709 -0.11006151 0.13824514 0.072320662
[2,]  0.044101015  0.01253397 -0.14474536 0.04638780 0.053958572
[3,]  0.056321442 -0.05187616 -0.03446175 0.16116869 0.083157308
[4,] -0.007440881 -0.08260800  0.10185594 0.04197086 0.116478071
[5,] -0.066293940 -0.26113343 -0.01156739 0.31020588 0.092619948
[6,]  0.075965993 -0.09815512 -0.08419202 0.27215043 0.001470058
          [,222]      [,223]       [,224]      [,225]      [,226]
[1,]  0.07041030  0.03555779  0.072285376  0.05357500 -0.07106956
[2,] -0.01374738  0.17003758 -0.019520387  0.03457224 -0.03713996
[3,]  0.04476531  0.13863727  0.004889852  0.10775344 -0.10282592
[4,] -0.02810579  0.01348006  0.009996367 -0.02153545 -0.11958762
[5,] -0.02968163 -0.01568093  0.022583006 -0.11505753  0.06802285
[6,]  0.04070271  0.14868467  0.062011078  0.05736085 -0.13058169
         [,227]      [,228]      [,229]      [,230]     [,231]
[1,] 0.16905032  0.03836681 -0.09137645  0.09602909 0.04561829
[2,] 0.06799433  0.05174431 -0.10136008 -0.01144294 0.05436248
[3,] 0.10437881  0.01218759 -0.05382705 -0.04475870 0.02737739
[4,] 0.20471486 -0.01401014 -0.14690535  0.07012411 0.07716142
[5,] 0.13378915 -0.01853155 -0.16943839  0.16641875 0.03436823
[6,] 0.13722783  0.03344594 -0.04833374  0.03120663 0.04564085
          [,232]      [,233]       [,234]    [,235]      [,236]
[1,] -0.04100875 -0.09729417 -0.015945243 0.2084298 -0.32908994
[2,] -0.09437405 -0.09850014 -0.015326987 0.1066173  0.06720883
[3,] -0.08152922 -0.04496773 -0.020547934 0.1454203 -0.18244785
[4,]  0.04185037  0.01151387 -0.006661795 0.1374446 -0.41618568
[5,] -0.01318259 -0.05339691 -0.204763591 0.1586502 -0.31462738
[6,] -0.02640618 -0.05233365  0.049708031 0.1770238 -0.44506806
           [,237]     [,238]     [,239]        [,240]     [,241]
[1,] -0.057311643 0.05173610 0.12793347  0.0748575628 -0.4823146
[2,] -0.113685295 0.12084391 0.06927693 -0.0003902306 -0.6902798
[3,] -0.088810235 0.06109840 0.03226926  0.0239857566 -0.4093242
[4,]  0.004091115 0.13506255 0.08105611  0.0400430895 -0.5522546
[5,] -0.093278319 0.09151746 0.08942989  0.0366468728 -0.6477040
[6,] -0.049687769 0.08295970 0.03150887 -0.0254437830 -0.3423410
           [,242]     [,243]     [,244]       [,245]      [,246]
[1,] 0.0491617545 0.08810919 0.16544563 -0.029332409  0.04919896
[2,] 0.0671593398 0.12259185 0.20401637  0.018133275  0.03448596
[3,] 0.0335012637 0.10995636 0.08732561 -0.021502355  0.03198661
[4,] 0.0002215922 0.12138499 0.14508900 -0.086681329  0.12600115
[5,] 0.0538666286 0.03495837 0.30469996 -0.012076542 -0.01498211
[6,] 0.0276439749 0.11181737 0.15175976 -0.001726018  0.13548543
          [,247]      [,248]    [,249]      [,250]      [,251]
[1,]  0.04697078 -0.04890043 0.1589750 -0.03094804  0.02603056
[2,]  0.19406812  0.14153977 0.1780439 -0.07918438  0.01485757
[3,]  0.05676338  0.05711843 0.1806150  0.02305853 -0.02673498
[4,] -0.04791526  0.09965809 0.1092957 -0.04397365 -0.01028533
[5,] -0.01059569  0.19260283 0.2623497  0.08115722 -0.01139705
[6,]  0.04929274  0.11131403 0.1806237 -0.02468466 -0.02996133
         [,252]       [,253]      [,254]      [,255]      [,256]
[1,] -0.1724897 -0.002401687  0.01534870  0.13890797 -0.11863050
[2,] -0.1395971  0.031402815  0.06491155 -0.02091154 -0.16273288
[3,] -0.1389630  0.088268481 -0.01522258 -0.01420320 -0.16057290
[4,] -0.1291551  0.046002023  0.05335227  0.03016902 -0.09637893
[5,] -0.1920401 -0.042774189 -0.08610818  0.23634340 -0.13199009
[6,] -0.1981733  0.067647107  0.09951241  0.02313998 -0.08580471
            [,257]       [,258]        [,259]     [,260]      [,261]
[1,] -0.0225894023  0.002869749  0.0007577947 -0.1680808 -0.01088620
[2,] -0.0189757459  0.013451111 -0.1751664877 -0.3328351  0.05819667
[3,] -0.0008530638 -0.031288225 -0.1339446753 -0.2323560  0.02520966
[4,] -0.0292648710  0.020038901 -0.0299417879 -0.1354145  0.04481651
[5,] -0.0285401363  0.079823844 -0.0336319245 -0.2776764  0.01303334
[6,]  0.0409367606  0.002441470 -0.2192038000 -0.1395366  0.02692296
           [,262]     [,263]      [,264]      [,265]       [,266]
[1,]  0.015875859 0.10763116 -0.05167066  0.03018143  0.042046655
[2,]  0.016516799 0.02993468 -0.07149611  0.04834108  0.030737203
[3,] -0.020461027 0.14536050 -0.03549042  0.11245230  0.044793285
[4,]  0.004487541 0.05348589 -0.09096584  0.01046701 -0.073750377
[5,] -0.015841294 0.12982632 -0.09173639 -0.16630651  0.018952580
[6,] -0.020832295 0.08133712 -0.02231704  0.01190614  0.007591155
           [,267]      [,268]       [,269]       [,270]        [,271]
[1,] -0.011430854 -0.02523194 -0.008423136 -0.012671799 -0.0837400183
[2,]  0.004502268 -0.03668711 -0.017272692  0.024523588 -0.0125292251
[3,] -0.003664760 -0.01398616 -0.037800763  0.038294815  0.0008871728
[4,] -0.022474337 -0.06638593 -0.031185303 -0.075725012  0.0010475843
[5,] -0.021464296 -0.07377630 -0.083129086 -0.036009334 -0.0625632778
[6,] -0.081773162  0.02574211 -0.016636886  0.002660608  0.0052323635
          [,272]        [,273]       [,274]       [,275]       [,276]
[1,] -0.05445842 -0.0093964469  0.007517941 -0.011246663 -0.050030861
[2,] -0.11006894  0.0164988823 -0.094942071  0.041801900 -0.018264698
[3,] -0.01204425 -0.0008054683  0.044470005  0.007643088 -0.007325893
[4,] -0.04889615  0.0439554788 -0.097014301  0.012413584 -0.069276668
[5,] -0.15815380 -0.0682735518 -0.078197189 -0.049895536 -0.007100256
[6,] -0.05562257  0.0194925591 -0.037227783  0.018591374 -0.016361907
           [,277]     [,278]      [,279]       [,280]       [,281]
[1,]  0.002760567 0.11517621 -0.06390390  0.071153320 -0.007525825
[2,] -0.065950707 0.12664177 -0.19320154  0.056531884  0.081739336
[3,] -0.068363689 0.10404641 -0.09738331  0.024798499  0.032022521
[4,]  0.191381738 0.07087343 -0.22808014  0.007383201  0.047871239
[5,] -0.167920634 0.06478498 -0.02706838  0.105121240  0.050797608
[6,] -0.134912848 0.05239017 -0.25800148 -0.030304926  0.061357789
          [,282]       [,283]      [,284]      [,285]      [,286]
[1,] -0.08069538  0.021202818 -0.09088831 0.003913802  0.17268385
[2,] -0.18115973  0.007516647  0.04322838 0.066528082  0.08921006
[3,] -0.05470851 -0.030388746  0.01764945 0.005210739  0.07403997
[4,] -0.03100875  0.030917926 -0.05289397 0.049072228  0.12345744
[5,] -0.14827476 -0.034416664 -0.12222683 0.077855960 -0.01282306
[6,] -0.06022647 -0.054439630  0.00454731 0.010294611  0.06895743
          [,287]      [,288]     [,289]     [,290]       [,291]
[1,]  0.03366879 -0.10051147 0.07276155 0.12489814 -0.029919706
[2,] -0.05449703 -0.13379160 0.05222794 0.09763101 -0.011916515
[3,] -0.03373038 -0.05401787 0.06726157 0.05924873 -0.003839437
[4,] -0.03131104 -0.12301756 0.14005129 0.12710060 -0.017647358
[5,] -0.64840341 -0.23175310 0.13674939 0.12690376 -0.084012493
[6,]  0.06048229 -0.13205385 0.02206899 0.06544769 -0.033752106
        [,292]        [,293]      [,294]      [,295]      [,296]
[1,] 0.1965406 -0.0471164025 -0.09477758 -0.09592266 -0.14934851
[2,] 0.1406389 -0.1141664833 -0.11793546 -0.03406483  0.03635797
[3,] 0.2234888 -0.0002842388 -0.14569619 -0.10272630 -0.06068196
[4,] 0.1935525  0.0183725003 -0.07485901 -0.10831285 -0.14020436
[5,] 0.1750222 -0.0604986213 -0.04264855 -0.07688938 -0.09810477
[6,] 0.1693811 -0.0750083998 -0.10084461 -0.08070657 -0.18682951
           [,297]      [,298]       [,299]       [,300]      [,301]
[1,]  0.005727845 -0.12093994 -0.003552702  0.020256335 0.016346853
[2,]  0.015381114 -0.02306485 -0.015180913  0.009877626 0.141062707
[3,]  0.015630685 -0.14868614 -0.007421072 -0.047970403 0.209519491
[4,] -0.049769286 -0.13912010  0.035268210 -0.045016538 0.171082839
[5,]  0.060936205 -0.17971252  0.027693467  0.137620136 0.006965111
[6,]  0.020025980 -0.08880578  0.018619476  0.059553828 0.181092486
          [,302]       [,303]       [,304]      [,305]       [,306]
[1,] -0.11119895  0.077715434  0.055607371 0.123822115 -0.059588451
[2,] -0.03967703 -0.057833292 -0.060716528 0.030593542  0.047125291
[3,] -0.01229836 -0.035303757 -0.023960592 0.009966978  0.012475309
[4,] -0.13119549 -0.068845138  0.002193379 0.147963077 -0.109287247
[5,] -0.11175846 -0.002594928 -0.062189352 0.033291709 -0.072154455
[6,] -0.03947608  0.094287872  0.019838080 0.029311704 -0.007268577
          [,307]      [,308]      [,309]      [,310]       [,311]
[1,]  0.05673822  0.05476711 -0.20486258  0.07061189 -0.062737666
[2,]  0.15709876 -0.02061976 -0.16822445  0.01269852 -0.004345024
[3,]  0.11021169  0.05043468 -0.07344368 -0.05323145  0.003844622
[4,]  0.19097759  0.03540033 -0.14295101  0.02988683 -0.021163179
[5,]  0.25572175  0.02911083 -0.12724619  0.06165682 -0.003929416
[6,] -0.01906445  0.13942367 -0.13242154  0.07677628 -0.046496250
          [,312]       [,313]       [,314]       [,315]        [,316]
[1,] -0.08939619 -0.062958047  0.002350205 -0.028255599  0.0001992079
[2,] -0.21793611 -0.065695688  0.139431939 -0.057130031  0.0188816339
[3,] -0.14733313 -0.054874431  0.075538740  0.003273665  0.0071602282
[4,] -0.13412905 -0.012387750  0.120887332  0.002740759 -0.0330684409
[5,] -0.28124347 -0.009996795  0.111794926  0.031146541 -0.1252306700
[6,] -0.05679907 -0.093764365 -0.010528004  0.028798489  0.0264520179
        [,317]      [,318]     [,319]       [,320]       [,321]
[1,] 0.2366612 -0.11066158 0.10403828 -0.093767919  0.015524159
[2,] 0.1956885 -0.10604562 0.16890952 -0.016343875 -0.001231328
[3,] 0.1087591  0.02513982 0.08264175 -0.071640648  0.017064070
[4,] 0.2386470 -0.14696006 0.13099055 -0.006232007 -0.001926191
[5,] 0.2298327  0.05288503 0.11605821 -0.037210070  0.103908330
[6,] 0.2072268 -0.02443120 0.07308445 -0.073828861  0.048229817
           [,322]     [,323]        [,324]      [,325]       [,326]
[1,]  0.015304311 0.06769788  0.0001059437  0.13685572 -0.007125911
[2,] -0.008312246 0.07099401  0.0118308347  0.11766487 -0.052791048
[3,] -0.018496867 0.02761492  0.0046130028  0.16656889 -0.009691294
[4,] -0.108083107 0.10613571 -0.0353088155 -0.03805166 -0.025139719
[5,] -0.039033186 0.16623124  0.0668120831  0.03538605 -0.161977589
[6,] -0.059934128 0.13409884  0.0132886814  0.06696119 -0.010411450
          [,327]      [,328]       [,329]     [,330]      [,331]
[1,] -0.09181453  0.16432312 -0.009687589 0.17562778  0.07574756
[2,] -0.06574848  0.01219540 -0.081525952 0.09776805 -0.61099488
[3,] -0.22979331 -0.00453141 -0.068012930 0.08546595 -0.64116883
[4,] -0.08695555  0.03141475 -0.049017664 0.07748068 -0.32160136
[5,] -0.17806914 -0.10213739 -0.101243451 0.16242576 -0.14651221
[6,] -0.01661999  0.07961593 -0.058121491 0.11321305  0.18859792
       [,332]        [,333]      [,334]       [,335]      [,336]
[1,] 1.193441  0.0129416380 -0.04349080  0.023731416 -0.01097963
[2,] 1.284796 -0.0026454674 -0.05538445  0.048212808 -0.02144463
[3,] 1.263941 -0.0068049454 -0.02919309  0.054390196 -0.03931105
[4,] 1.251522  0.0002867049 -0.12403233 -0.007573304 -0.04308565
[5,] 1.432551  0.0599770546 -0.14562739  0.028240087 -0.01404148
[6,] 1.122777  0.0230755098 -0.16138813  0.047617856 -0.04634143
            [,337]     [,338]     [,339]    [,340]      [,341]
[1,] -0.0005624792 0.07864352 0.04369727 0.2572507 -0.13316961
[2,] -0.0054396740 0.05523947 0.15087622 0.1561821 -0.16100292
[3,]  0.0424030162 0.10528552 0.11152666 0.1685743 -0.11688816
[4,]  0.0157117005 0.06848166 0.05481624 0.1754922 -0.19357994
[5,] -0.0011950094 0.06173320 0.07855321 0.1942654 -0.14314735
[6,]  0.0254576858 0.10283647 0.07377444 0.1628036 -0.05531729
           [,342]      [,343]      [,344]       [,345]       [,346]
[1,]  0.084040277 -0.20822357 -0.01748156  0.036807824  0.006929139
[2,]  0.022380980 -0.24127041 -0.01108753  0.003058314 -0.040675364
[3,]  0.028627515 -0.14913662 -0.02476752  0.031754505 -0.023920799
[4,]  0.064644255 -0.08234471 -0.10837119  0.067176044  0.017211705
[5,]  0.095448487 -0.23304875  0.01558274  0.068599999  0.039748468
[6,] -0.008355043 -0.17206128 -0.02875835 -0.000583343  0.013256798
           [,347]      [,348]     [,349]     [,350]      [,351]
[1,] -0.005286428 -0.05701319 0.13193549 0.08130930  0.04443504
[2,] -0.086272962 -0.02544612 0.10772895 0.13471921  0.15701103
[3,]  0.002710936 -0.10538142 0.07507202 0.07743213  0.12704344
[4,] -0.040683534 -0.05692405 0.13225992 0.18849103 -0.02326316
[5,]  0.039327800 -0.01303095 0.11355264 0.07589500  0.13782470
[6,] -0.079469174 -0.02516594 0.06308875 0.05220953  0.07971393
          [,352]       [,353]     [,354]     [,355]      [,356]
[1,] -0.02041185  0.024838975 0.15259443 0.03433982  0.01410498
[2,] -0.15240444 -0.043450933 0.08405434 0.05179580 -0.02859024
[3,] -0.13477083 -0.027553072 0.08378947 0.04356062 -0.05607921
[4,]  0.00702041 -0.009490191 0.10871423 0.01426539  0.13265060
[5,]  0.04278595  0.179218471 0.21891491 0.02857704  0.13487510
[6,] -0.01153280  0.004404217 0.07570871 0.07068371  0.11111432
            [,357]      [,358]         [,359]     [,360]    [,361]
[1,] -0.0292523298  0.03229756  0.06580498815 -0.3292757 0.1424101
[2,]  0.0261140857  0.07876643  0.07768756896 -0.2670496 0.2002343
[3,]  0.0005733054  0.03968107 -0.03592544794 -0.2605197 0.1676459
[4,] -0.0405364856  0.05002245  0.05217316374 -0.1848912 0.1879823
[5,]  0.0207061786  0.03774624  0.11750797927 -0.6159015 0.2709713
[6,] -0.0419533104 -0.01498811 -0.00003440182 -0.1675033 0.1870018
            [,362]     [,363]       [,364]      [,365]      [,366]
[1,]  0.0003190466 0.10675317 -0.111781068 -0.26239395 -0.05190451
[2,]  0.0764605403 0.06744294 -0.010644180 -0.08685648 -0.06909190
[3,]  0.0122582344 0.06609353 -0.046548788 -0.04289630 -0.16739215
[4,] -0.0306625608 0.13241743 -0.007170338 -0.22639199 -0.08798391
[5,] -0.0633786842 0.06781193 -0.142221734 -0.24863669 -0.08552787
[6,]  0.0074897874 0.13996646 -0.026384473 -0.11121219 -0.05444014
         [,367]    [,368]      [,369]       [,370]     [,371]
[1,] -0.2834142 0.1727780 -0.07177187 -0.024423050 0.11998454
[2,] -0.2122738 0.1857841 -0.08979926 -0.061952963 0.18627794
[3,] -0.2145126 0.1474682 -0.06742267  0.003836003 0.16774292
[4,] -0.3423468 0.2046937 -0.09281652 -0.062675677 0.07005385
[5,] -0.4036809 0.1320605 -0.07927746  0.047409087 0.14555788
[6,] -0.2898973 0.1320122 -0.10214323 -0.049238041 0.14702497
           [,372]       [,373]      [,374]      [,375]       [,376]
[1,] -0.041142341 -0.018378917  0.01463352 -0.08249739  0.071360566
[2,]  0.004512242  0.056799449 -0.10813290 -0.12739737  0.108280510
[3,] -0.006871527  0.012354914 -0.05375824 -0.09662658  0.045653116
[4,]  0.067509219 -0.007863864 -0.09351169  0.03765030 -0.020628667
[5,]  0.089546248  0.028547799 -0.16447680 -0.04109525  0.001788142
[6,] -0.043425713  0.015164633 -0.11218750 -0.05097958  0.068636134
          [,377]       [,378]      [,379]       [,380]      [,381]
[1,]  0.12089308 -0.013052741  0.16159718 -0.033959396 -0.05752983
[2,] -0.01441357  0.005857999 -0.02121415 -0.036436468 -0.05078482
[3,]  0.02916666  0.013266120  0.13223200 -0.067180336 -0.04920297
[4,]  0.08411981 -0.018478211  0.22633652 -0.132887974 -0.00440924
[5,] -0.01408248 -0.024376320  0.23904698 -0.001653882 -0.07003044
[6,]  0.02938977  0.006751281  0.12645385 -0.053276427 -0.10031450
           [,382]       [,383]     [,384]     [,385]       [,386]
[1,] -0.022969488 -0.080281503 0.06668742 0.10190790  0.129292399
[2,]  0.121824607 -0.015189585 0.08290621 0.06280330  0.016867727
[3,]  0.006504176 -0.002793557 0.08314306 0.12468025 -0.008007731
[4,] -0.073884942 -0.102000907 0.03791762 0.13350716  0.163697481
[5,]  0.017336383 -0.135498956 0.08327901 0.24546270  0.137031600
[6,]  0.013923938 -0.113184415 0.04481167 0.04153857 -0.015584327
          [,387]      [,388]    [,389]       [,390]      [,391]
[1,]  0.04810674 -0.07212174 0.3981770  0.000651068 -0.01844281
[2,]  0.08981262 -0.05153822 0.2162744 -0.028560745 -0.05627009
[3,]  0.03696474 -0.01001888 0.1683803 -0.063800417 -0.06998126
[4,]  0.04972491 -0.02204287 0.4260711 -0.051906057 -0.01058496
[5,]  0.15990907 -0.04117636 0.5371452 -0.097876579 -0.09795716
[6,] -0.01717817 -0.02943450 0.2676919 -0.051112194 -0.09012391
          [,392]      [,393]       [,394]        [,395]      [,396]
[1,]  0.09665750 -0.21984693  0.077912547 -0.0058517088  0.01657313
[2,] -0.03973968 -0.19702394 -0.096619479 -0.0071436288 -0.05720001
[3,] -0.01701060 -0.11564402 -0.038870413  0.0449757017 -0.04972860
[4,]  0.03982517 -0.18398654 -0.002435916  0.0043237559 -0.01682329
[5,]  0.06203847 -0.05672979  0.094466582  0.0115374159  0.02329841
[6,]  0.09998129 -0.06618091  0.092190057  0.0006072707 -0.01348944
          [,397]     [,398]    [,399]       [,400]      [,401]
[1,] 0.029640796 -0.2341008 0.2731010 -0.031091580 -0.01752099
[2,] 0.008583851  0.1481631 0.2792898 -0.064082794 -0.07462133
[3,] 0.040935591  0.1765531 0.2668295 -0.038621537 -0.06084965
[4,] 0.081413433 -0.2189223 0.2725447 -0.195925117 -0.03351154
[5,] 0.186902285  0.1041174 0.2916219 -0.148684010 -0.07247491
[6,] 0.037978858 -0.2098601 0.2650369 -0.003034409 -0.08609407
           [,402]      [,403]      [,404]      [,405]       [,406]
[1,] -0.055302404 -0.08445628 0.124047980 -0.07431474  0.033396285
[2,]  0.026117302 -0.06102932 0.003592577  0.07306582 -0.087093271
[3,] -0.026919138 -0.02823371 0.013763811  0.06260777  0.003319245
[4,] -0.084522232  0.01085360 0.148553595  0.14148732  0.085137658
[5,]  0.004054369 -0.05274140 0.276448041 -0.02868071 -0.083662651
[6,]  0.085933879 -0.04678488 0.110170588  0.11049432 -0.065488786
            [,407]       [,408]      [,409]     [,410]        [,411]
[1,] -0.0833341256 -0.014363504 -0.08923447 0.18580405  0.0527944863
[2,]  0.0011571615 -0.042233806 -0.05868121 0.10632948 -0.0005507554
[3,] -0.0839891359  0.001657259 -0.11240651 0.09383041  0.0061236657
[4,] -0.0770618767 -0.014581834 -0.18196091 0.16608985  0.0234143566
[5,] -0.0693483502 -0.138323084 -0.20459747 0.23080853  0.0352744423
[6,] -0.0009951121  0.019755036 -0.15968242 0.11442276 -0.0185750797
         [,412]     [,413]      [,414]    [,415]      [,416]
[1,] 0.07303324 0.10113084 -0.06256250 0.1384585 -0.09067871
[2,] 0.02094452 0.04001701 -0.03109857 0.1248479 -0.06825428
[3,] 0.03956146 0.01913995 -0.01180687 0.1212969 -0.06751077
[4,] 0.03233004 0.07872116  0.06508625 0.0848489 -0.03301696
[5,] 0.07095757 0.02153363  0.14255515 0.1556596 -0.03317551
[6,] 0.06180367 0.02782013  0.06218156 0.1112180 -0.04977389
           [,417]      [,418]       [,419]      [,420]      [,421]
[1,]  0.019350978  0.01523919 -0.034700625 -0.15207638 -0.09571344
[2,]  0.015089027 -0.13927549  0.059285089 -0.07940488 -0.13693495
[3,] -0.001048695 -0.03808055 -0.063612774 -0.05192776 -0.18541250
[4,]  0.031780388 -0.08320169  0.066831119  0.02576646 -0.08961902
[5,]  0.039614756 -0.10220528 -0.120935448 -0.17789137 -0.10625569
[6,]  0.058109745 -0.01198777 -0.004356108  0.08624344 -0.10441324
          [,422]     [,423]      [,424]    [,425]       [,426]
[1,] -0.02452135 0.14253086 -0.05657317 0.3280779 -0.050315730
[2,] -0.06415525 0.07602257 -0.06367315 0.1944746 -0.065398335
[3,] -0.06640281 0.02816646 -0.09902421 0.1656896 -0.024696238
[4,] -0.04900699 0.19998491 -0.10840013 0.3802281  0.003306185
[5,] -0.01606719 0.20564817  0.00140973 0.6608974  0.056467004
[6,] -0.03569328 0.09580938 -0.06109742 0.1208945 -0.076438911
           [,427]      [,428]       [,429]      [,430]      [,431]
[1,] -0.057930082 -0.05862350 -0.095415689 -0.10481034 -0.06387607
[2,]  0.010639274 -0.12303247 -0.051223289 -0.09339171 -0.05981595
[3,] -0.001297983 -0.03304556 -0.122825339 -0.12358673 -0.06911961
[4,] -0.123188123 -0.16720073  0.003969586 -0.10472445  0.06382620
[5,] -0.115927018 -0.08907121 -0.051757324 -0.17229636 -0.06435966
[6,] -0.064655416 -0.06646870 -0.047626436 -0.13625301  0.03774286
         [,432]       [,433]     [,434]      [,435]       [,436]
[1,] 0.13167702 -0.043118063 0.06146807  0.01869973 -0.035224576
[2,] 0.16845942 -0.192152798 0.13094904  0.03596283  0.033534888
[3,] 0.14747572 -0.076833479 0.13047643  0.02428866  0.014121264
[4,] 0.25472251 -0.007195167 0.15603444 -0.00596704 -0.059642036
[5,] 0.07380281 -0.071108758 0.15276530  0.05286176 -0.119509064
[6,] 0.11972743 -0.148522720 0.09822256 -0.08528683 -0.005617861
           [,437]      [,438]      [,439]      [,440]      [,441]
[1,]  0.002619761 -0.08160212  0.08646131 -0.07696088  0.06323978
[2,] -0.009239418 -0.10202175 -0.02077171 -0.06891251  0.05190685
[3,] -0.009320967 -0.04484579  0.10739184 -0.02527408 -0.00380435
[4,]  0.054793835 -0.07226864  0.01493895 -0.08142722  0.07248068
[5,] -0.043097962 -0.18096198 -0.06011949 -0.18862140  0.21504816
[6,]  0.023491399 -0.01777480  0.07863464 -0.12527528  0.16570453
         [,442]      [,443]      [,444]      [,445]       [,446]
[1,] 0.01898709 0.092833392  0.06426620  0.10507441  0.084170453
[2,] 0.05463684 0.003707611 -0.09394057  0.05733651  0.106665961
[3,] 0.04206577 0.029764373  0.01227091  0.08231951  0.069943115
[4,] 0.09810630 0.079904787  0.07489314 -0.01253995 -0.008394581
[5,] 0.06945176 0.109472521  0.04685316  0.04640696  0.102879412
[6,] 0.03247901 0.101068415  0.01057376  0.11562008  0.069222540
           [,447]     [,448]       [,449]      [,450]    [,451]
[1,] -0.024374206 0.04312007  0.107861504  0.13711369 0.1291108
[2,]  0.001252827 0.08850355  0.049432795  0.06416221 0.1807139
[3,] -0.038332362 0.08287523  0.023291139  0.06984615 0.1361608
[4,] -0.021328092 0.12580599  0.139093950  0.06507008 0.1231573
[5,] -0.129619345 0.10041834  0.199645579 -0.01893841 0.1511120
[6,] -0.030451402 0.09080670 -0.002246229  0.09229445 0.1914775
          [,452]     [,453]    [,454]       [,455]       [,456]
[1,] -0.06324755 -0.2063144 -1.571300  0.011344370  0.010410558
[2,] -0.08418371 -0.2678480 -2.114250 -0.065529682 -0.081989832
[3,] -0.04842710 -0.1767584 -2.138216  0.027580163 -0.015867468
[4,]  0.02564547 -0.1488806 -1.496716 -0.007744787 -0.008718793
[5,] -0.05997337 -0.4564939 -1.645690  0.049410906  0.040771157
[6,] -0.11389697 -0.2701066 -1.500608 -0.003843458  0.063257314
         [,457]      [,458]      [,459]      [,460]      [,461]
[1,] 0.03868202 -0.05845854 -0.12579459 0.005873961 -0.04595002
[2,] 0.10147323 -0.04141930 -0.09119720 0.114982814 -0.09992974
[3,] 0.04151445 -0.04142060 -0.09097617 0.015678143 -0.05815847
[4,] 0.03656706 -0.14261545 -0.21980679 0.045785569 -0.01823764
[5,] 0.11710306 -0.07848915 -0.34025028 0.061278366  0.03995755
[6,] 0.01473739 -0.09901690 -0.18111326 0.036432479 -0.08962186
           [,462]       [,463]       [,464]      [,465]      [,466]
[1,] -0.022218920 -0.009022172  0.064793751 -0.01880163 -0.09919238
[2,] -0.148305222 -0.019372806 -0.015265632  0.08394215 -0.10314022
[3,] -0.073457286  0.009041996 -0.009008986  0.06632591 -0.02867668
[4,]  0.006836804 -0.142976373  0.013609613  0.10924794 -0.05234744
[5,] -0.121134020 -0.058553871 -0.002999091  0.01065715 -0.04240579
[6,] -0.073510975 -0.042291988  0.015074087  0.04148116 -0.08730940
         [,467]     [,468]      [,469]        [,470]      [,471]
[1,] -0.1562882 0.09386369  0.01467662  0.0904685780 -0.14649619
[2,] -0.1320574 0.11428429 -0.06193297  0.0262522604 -0.01595671
[3,] -0.1121669 0.13802610  0.14548612  0.0356551185  0.04380416
[4,] -0.1064183 0.10055429  0.02231788  0.0873961374 -0.01238519
[5,] -0.1398273 0.35697773 -0.11256426  0.0611174740 -0.14872175
[6,] -0.2030301 0.02190426  0.00917128 -0.0002893528 -0.02008463
          [,472]       [,473]      [,474]      [,475]      [,476]
[1,]  0.06360921  0.002835296 -0.14112200  0.01089384 -0.09374716
[2,] -0.09267101 -0.011794514 -0.09564537  0.09496267 -0.09849050
[3,] -0.06956573 -0.032383204 -0.06577902  0.05314546 -0.08813422
[4,]  0.06355684 -0.006422742 -0.14174026  0.01064497 -0.12374763
[5,]  0.07341044 -0.028724032 -0.13385014 -0.01298049 -0.06281004
[6,]  0.02312492 -0.038785104 -0.03216275  0.07268793 -0.11918852
           [,477]    [,478]      [,479]      [,480]      [,481]
[1,]  0.085721515 0.2369088 -0.03163733 -0.04961759  0.07567289
[2,]  0.212540090 0.4052520 -0.06378204  0.06538963  0.06334462
[3,]  0.035656735 0.3395200 -0.12373400  0.06951213  0.03967689
[4,]  0.069634311 0.3115078 -0.04387229  0.01914976  0.02651158
[5,]  0.093301833 0.1765930 -0.06029833  0.04276315 -0.01899371
[6,] -0.007837979 0.4033882  0.01032726  0.09456421  0.03680502
           [,482]      [,483]       [,484]       [,485]       [,486]
[1,]  0.014224278 -0.04090451  0.028643118  0.005485986  0.024289938
[2,]  0.028082833  0.12406152  0.050737426  0.004382323  0.031838104
[3,] -0.011032891  0.11820289  0.030434420  0.024688704  0.056926142
[4,]  0.058519281  0.02351317  0.002203047  0.014882185  0.109045506
[5,]  0.030299021 -0.03670148 -0.004659429  0.038361084 -0.009311764
[6,] -0.008477365  0.01284167  0.008294596 -0.044905756  0.010071323
           [,487]       [,488]     [,489]      [,490]      [,491]
[1,]  0.027732164 -0.054697767 0.08244185 -0.01940191 -0.18509653
[2,] -0.079287864  0.041016314 0.07844529 -0.07530592 -0.10736346
[3,] -0.002462003  0.028426407 0.04889518 -0.06274561 -0.01069009
[4,] -0.104643159  0.001387747 0.01470165 -0.03739887 -0.08979299
[5,] -0.052101936  0.134826988 0.06035344  0.02556883 -0.08897312
[6,] -0.078772254 -0.022792758 0.03378720 -0.09432817 -0.05770224
          [,492]      [,493]    [,494]     [,495]      [,496]
[1,] -0.03261138  0.01393211 0.1644626 0.10143952 -0.01441867
[2,] -0.19953111  0.05215713 0.1580814 0.10161492 -0.05557086
[3,] -0.11720665  0.09111667 0.1566399 0.11439383 -0.04178641
[4,] -0.02815072 -0.02023082 0.2387220 0.11720078  0.06616344
[5,] -0.11564896 -0.05522026 0.1704042 0.08389510  0.07512923
[6,] -0.09523348  0.08016193 0.2092725 0.09535258 -0.05332264
          [,497]      [,498]      [,499]       [,500]       [,501]
[1,]  0.13447063 0.176436096 -0.15089904  0.008123890 -0.062278148
[2,] -0.14183965 0.101238340  0.16178432 -0.021955615 -0.004715705
[3,] -0.11346148 0.155305624  0.08963346  0.015225065 -0.032031965
[4,]  0.07938032 0.187938437 -0.41815472 -0.008774522  0.033738963
[5,]  0.18068925 0.002046947 -0.19629756 -0.005373829  0.010599384
[6,] -0.17102486 0.110839099  0.01813341  0.027815249 -0.043837361
          [,502]     [,503]       [,504]     [,505]     [,506]
[1,] -0.06082680 0.16952525  0.006600899 0.10919487 0.03599295
[2,] -0.01016839 0.11328282  0.014151102 0.12925433 0.03840022
[3,] -0.01715080 0.12347469  0.032013722 0.14595447 0.03473345
[4,] -0.02428205 0.11775508 -0.134463638 0.11429659 0.08892217
[5,] -0.08576907 0.08981242 -0.034434706 0.03607088 0.17811798
[6,]  0.01329549 0.08677683  0.127937108 0.19148800 0.04910553
           [,507]       [,508]      [,509]      [,510]      [,511]
[1,] -0.081771679 -0.109140441 -0.07335753 -0.01502807 -0.01548101
[2,]  0.022215756 -0.021342721 -0.08955568  0.04025942 -0.02196560
[3,] -0.009848425 -0.045117740 -0.05692595  0.01472343 -0.02373696
[4,] -0.019649435 -0.007875388 -0.07495666  0.03273108 -0.04050305
[5,] -0.024837051 -0.084895268  0.02489420  0.10396164  0.08499401
[6,] -0.058013108 -0.079431497 -0.02372424  0.03251337 -0.06706781
         [,512]     [,513]       [,514]     [,515]     [,516]
[1,] 0.20747209 0.10412335  0.030921176 0.04140276 0.13099532
[2,] 0.24077047 0.07284018  0.027469020 0.10394826 0.11812397
[3,] 0.07832344 0.05361049 -0.003711764 0.01981778 0.14238910
[4,] 0.22885244 0.09878208  0.029369308 0.01469264 0.08092756
[5,] 0.09952058 0.11782581 -0.058057539 0.01267564 0.13141654
[6,] 0.21342711 0.05211563 -0.037015975 0.08124081 0.14627922
           [,517]      [,518]    [,519]    [,520]      [,521]
[1,] -0.096544601 -0.02722531 0.1704053 0.6414233 -0.10801749
[2,] -0.068766735 -0.03247895 0.2348349 0.4556105 -0.04150981
[3,] -0.074356921 -0.05799698 0.2257889 0.3981168 -0.05121266
[4,] -0.007750449  0.01547960 0.1302545 0.4229303 -0.05532151
[5,] -0.035133030 -0.05410383 0.3415779 0.2393515  0.01129965
[6,]  0.055697769 -0.07908421 0.3142245 0.2538634 -0.13136469
          [,522]      [,523]       [,524]         [,525]       [,526]
[1,] 0.028488843  0.01229791  0.006769815 -0.02220854349  0.008598752
[2,] 0.090912819 -0.04902017 -0.038836576 -0.05532822385 -0.013462212
[3,] 0.041311838  0.05117850 -0.030412136  0.00006190916  0.024389319
[4,] 0.089615382  0.05270386  0.011018316  0.00578867877  0.048756767
[5,] 0.005162219 -0.01371515  0.028771298 -0.07557101548  0.118265748
[6,] 0.070394009  0.04985644 -0.056496751 -0.04647116736  0.046551116
           [,527]      [,528]     [,529]       [,530]      [,531]
[1,] -0.080438398 -0.05049169 0.06124162 -0.037969735 -0.10010156
[2,] -0.052286796  0.05558256 0.04355393 -0.065679953  0.28628990
[3,] -0.053335365  0.05906692 0.07683131  0.002506749  0.15025698
[4,]  0.050195921  0.04279092 0.01739311 -0.035167418  0.07004783
[5,]  0.004074886  0.08705671 0.13898785 -0.020913765  0.01851276
[6,] -0.033718653  0.01462394 0.15657954  0.006698030  0.16144638
         [,532]     [,533]       [,534]      [,535]      [,536]
[1,] -0.1132798 0.05667033  0.024161274 -0.03244631 -0.02328633
[2,] -0.1149235 0.14032076  0.022697564 -0.08682737 -0.01391359
[3,] -0.1466271 0.07502884  0.012020401 -0.04629718  0.03811403
[4,] -0.1270624 0.04202068 -0.072816454 -0.04554997 -0.06863053
[5,] -0.1100831 0.17043321 -0.002551615 -0.16728048  0.06786533
[6,] -0.1331794 0.06237527  0.017379900 -0.07297575  0.03169990
           [,537]      [,538]     [,539]       [,540]      [,541]
[1,] -0.049195871 -0.05195329 0.10871506  0.004009936  0.04403062
[2,]  0.079532564  0.10515817 0.20094171  0.148961648 -0.09903095
[3,] -0.007620021  0.04351531 0.04169322  0.079800084  0.05986871
[4,] -0.082801260 -0.01348173 0.09745122  0.073346667  0.11053089
[5,] -0.010112019  0.02520639 0.14831597 -0.052286886 -0.07703506
[6,] -0.040300995  0.02824445 0.13761625  0.132395297  0.06715680
          [,542]       [,543]     [,544]      [,545]        [,546]
[1,] -0.09582030  0.061663870 0.10744517 0.060571976 0.02810172178
[2,] -0.09636804  0.151209295 0.13660660 0.107330613 0.05540509522
[3,] -0.01025726  0.078234747 0.10478605 0.050891187 0.03553915024
[4,] -0.05504660  0.001779500 0.10987019 0.024541641 0.15697939694
[5,] -0.02101547  0.126134664 0.09540144 0.086240515 0.10588035733
[6,] -0.02692613 -0.007448914 0.05709149 0.003051612 0.00007900961
         [,547]     [,548]       [,549]       [,550]      [,551]
[1,] 0.02419191 0.08803953 -0.080621943 -0.074648671 -0.03054844
[2,] 0.05273153 0.07319796  0.049742538 -0.011444277 -0.04701106
[3,] 0.06160079 0.09243686  0.001928369  0.070776083  0.05945547
[4,] 0.09536791 0.07475567 -0.086712070  0.001008996  0.13148466
[5,] 0.03845917 0.03740457 -0.089416340  0.134222209 -0.03225615
[6,] 0.03995414 0.01827375 -0.035682827  0.096883036  0.09749158
       [,552]     [,553]       [,554]     [,555]      [,556]
[1,] 3.490957 0.09625969  0.059705943 -0.2869728 -0.07438415
[2,] 3.009406 0.06977017  0.016659489 -0.2880733  0.00384901
[3,] 2.826385 0.09348783  0.016458966 -0.2091832 -0.02817199
[4,] 2.873447 0.06551965  0.091334976 -0.3344169 -0.03123012
[5,] 2.630254 0.01768534 -0.009353253 -0.1667103  0.03629993
[6,] 2.829683 0.14530991  0.045351252 -0.3220121 -0.02746979
           [,557]       [,558]      [,559]      [,560]       [,561]
[1,] -0.040171362  0.002730965 -0.04682355 -0.07253763 -0.007843177
[2,]  0.003828358  0.015141261 -0.02566535  0.01270058  0.016795876
[3,]  0.013223354  0.004305525 -0.02875073 -0.03749710  0.011652901
[4,]  0.006316597  0.009411959 -0.02258588 -0.11649830  0.015000288
[5,] -0.050341222 -0.014990398 -0.06293204 -0.13567844  0.025790883
[6,] -0.016510585  0.100776270 -0.02727570 -0.01096613  0.043969691
          [,562]       [,563]      [,564]        [,565]       [,566]
[1,] -0.10107207 -0.090766735  0.05772920  0.0357586853 -0.007650903
[2,]  0.25792950 -0.004117329 -0.04113457 -0.0826064125  0.031086469
[3,]  0.14507194 -0.033674099 -0.00137327 -0.0002648491  0.002827710
[4,] -0.24326281 -0.060469653  0.04351293 -0.0448633507  0.019339940
[5,] -0.33636457 -0.015884975  0.11548383  0.0600102246  0.033983886
[6,] -0.03306252 -0.088506110 -0.01203969 -0.1086494625 -0.042369910
         [,567]     [,568]      [,569]      [,570]       [,571]
[1,] 0.15585314 0.13051005 0.108799525 0.064547881 -0.007139327
[2,] 0.01048216 0.13346034 0.059202123 0.051440962 -0.097843759
[3,] 0.03364506 0.08602677 0.066494778 0.020454615 -0.141242966
[4,] 0.16724968 0.18270221 0.004842736 0.019932335 -0.105267487
[5,] 0.19563849 0.05251458 0.017202612 0.179404736  0.375534475
[6,] 0.07881544 0.13055730 0.071095765 0.004675159 -0.218478486
            [,572]        [,573]      [,574]      [,575]       [,576]
[1,]  0.0058474680 -0.0531055890  0.11780847 -0.03810208  0.019046675
[2,] -0.0034160153 -0.0007439902  0.19959642  0.04476420 -0.036860768
[3,] -0.0167324562 -0.0843516439  0.29047588  0.04091063 -0.002043449
[4,] -0.0376024060  0.0235952139  0.06060461 -0.06478819  0.069602810
[5,]  0.0257282034 -0.0984239876 -0.03339000  0.03665282  0.051747896
[6,] -0.0002246065  0.0356406122  0.26451844 -0.04111731  0.015969321
          [,577]    [,578]      [,579]        [,580]      [,581]
[1,] 0.051728375 0.2837152 -0.12573980 0.04450747371 -0.20007625
[2,] 0.006162872 0.2887946 -0.14360166 0.12143808603 -0.07812190
[3,] 0.032963041 0.2407141 -0.13535056 0.05022520199 -0.03726773
[4,] 0.007787528 0.3056432 -0.10764431 0.00005984147  0.01136403
[5,] 0.043765217 0.4460579 -0.18649001 0.03132902831 -0.18883580
[6,] 0.013649425 0.2142384 -0.00264157 0.05455103889 -0.15630220
          [,582]        [,583]     [,584]     [,585]     [,586]
[1,]  0.04763975 -0.1027267799 0.08992080 0.12758245 0.13977332
[2,]  0.03859643  0.0130787063 0.19769299 0.10191844 0.11003129
[3,]  0.05335652  0.0005924911 0.20755954 0.15173234 0.08798728
[4,]  0.07987957 -0.0494213626 0.12524505 0.08972426 0.07025620
[5,]  0.10612362 -0.0147182839 0.10312622 0.20463093 0.27740616
[6,] -0.03431785  0.0195534118 0.06446878 0.16805252 0.12031044
           [,587]       [,588]   [,589]       [,590]      [,591]
[1,] -0.196053058 -0.146547332 10.55038  0.079190038 -0.04186701
[2,] -0.009361898 -0.084520370 10.62850 -0.006851233 -0.01928166
[3,] -0.027103726 -0.092572533 10.67282 -0.018484965 -0.01760916
[4,] -0.157154799  0.041249577 10.60373 -0.035592694 -0.05346956
[5,] -0.276923925  0.007194216 10.01591  0.077082850 -0.11309950
[6,]  0.087701470 -0.180597544 11.05808 -0.048482083 -0.05305341
         [,592]     [,593]      [,594]        [,595]      [,596]
[1,] 0.11649291 0.02831738  0.04861200  0.0386349931 -0.01457212
[2,] 0.13541912 0.04426802  0.05433436 -0.0221196022 -0.10279615
[3,] 0.12529573 0.07380189  0.03893021  0.0117186746 -0.06627520
[4,] 0.09005984 0.10297865  0.06968775  0.0643280819 -0.11483820
[5,] 0.06878667 0.08176273 -0.01724512  0.0463816263 -0.08895335
[6,] 0.13597111 0.11060708 -0.03129032 -0.0007398911 -0.11685614
          [,597]       [,598]      [,599]        [,600]      [,601]
[1,]  0.01919353  0.030889636 -0.02790228  0.0506280921  0.09110180
[2,] -0.05993731  0.039520446 -0.07885469 -0.0756680071  0.03081270
[3,]  0.10984821  0.007104009 -0.09006495 -0.0352274142 -0.01103595
[4,]  0.08354216 -0.054511044 -0.04526887 -0.0006344669  0.07211627
[5,] -0.05610860  0.090620331 -0.03970441  0.1431293339  0.08085971
[6,] -0.07293376  0.055972077 -0.07523298  0.0279906746  0.04177547
          [,602]       [,603]       [,604]     [,605]     [,606]
[1,] -0.01676150 -0.003624233  0.008825682 -0.2234787 0.18158303
[2,] -0.11423547 -0.006869983 -0.095324494 -0.1961642 0.14314942
[3,] -0.10119756 -0.005852762 -0.058466714 -0.2928435 0.11609706
[4,]  0.03140411 -0.021237850  0.026722971 -0.1151845 0.16916385
[5,] -0.01638347 -0.096810423  0.053151648 -0.2580744 0.07612113
[6,] -0.09530030  0.032139529 -0.049519286 -0.2045097 0.12998132
         [,607]       [,608]       [,609]      [,610]       [,611]
[1,] 0.07298457 -0.002651701 -0.158432558 -0.04743477 -0.005269919
[2,] 0.11046232  0.057270877  0.016978169 -0.10646354  0.004269409
[3,] 0.18984833  0.023391020  0.003230169 -0.14901696  0.011862932
[4,] 0.02340865  0.045395304  0.039700259 -0.02079147  0.003488605
[5,] 0.06108408  0.064282469  0.080747120  0.16635144 -0.024059182
[6,] 0.09323003 -0.007702209  0.046257153 -0.05669680 -0.016939459
        [,612]     [,613]       [,614]     [,615]      [,616]
[1,] 0.4457970 0.05577384  0.067969643 0.11045261 -0.13252786
[2,] 0.1118504 0.01980666  0.163218647 0.23445050 -0.05967879
[3,] 0.1646561 0.02292584  0.041179903 0.23108661 -0.09604835
[4,] 0.2329158 0.07637633  0.008157513 0.23833963  0.04642060
[5,] 0.9287996 0.01388288 -0.051213335 0.28340751 -0.15695475
[6,] 0.2541634 0.01503851  0.088469163 0.03579002 -0.12264512
          [,617]      [,618]      [,619]      [,620]     [,621]
[1,] -0.03382699 -0.06885208 -0.10973601  0.18532184 0.04200668
[2,]  0.01342961 -0.18169832 -0.16695282 -0.02456107 0.05904873
[3,] -0.02139417 -0.13064028 -0.09058248  0.02769518 0.03524665
[4,] -0.06634750 -0.21438241 -0.05371312  0.04360333 0.03625013
[5,] -0.15594494 -0.12468186 -0.04595389 -0.13771467 0.09732056
[6,] -0.10214241 -0.10415285 -0.10364988  0.03797656 0.01805913
          [,622]      [,623]      [,624]     [,625]       [,626]
[1,] -0.02282365  0.08494413 -0.02972709 -0.2462529 -0.055069294
[2,] -0.02308360  0.07176681  0.02247033 -0.2373391 -0.015013164
[3,] -0.02676908  0.09027924  0.09314279 -0.1643709 -0.012452682
[4,] -0.01139543  0.05307195 -0.02017500 -0.3225598 -0.016039358
[5,] -0.06631549 -0.01779379 -0.13958761  0.3482752 -0.000444417
[6,]  0.08783573  0.02368183  0.20505987 -0.4261086  0.038747206
           [,627]      [,628]     [,629]     [,630]      [,631]
[1,]  0.024370451 -0.04531929 0.02464755 0.06753983 -0.02750900
[2,]  0.040073313  0.16513161 0.03286229 0.11217613 -0.01320007
[3,]  0.048136637 -0.03035239 0.06777806 0.07820796 -0.02618234
[4,] -0.004290697  0.11767638 0.09995991 0.17675555 -0.06916409
[5,] -0.067067407  0.06463806 0.06637219 0.02278540 -0.12282576
[6,]  0.081883602  0.06337563 0.05944666 0.11099052 -0.05610881
         [,632]        [,633]      [,634]      [,635]       [,636]
[1,] 0.06387967  0.0353682823  0.01161192 -0.09307051 -0.032301307
[2,] 0.04192519 -0.0545239002  0.04249949  0.04873569  0.057895780
[3,] 0.04624534 -0.0129249850  0.06176883  0.01341312  0.042152233
[4,] 0.10888313  0.0351713225  0.07008977 -0.03464171  0.001583954
[5,] 0.01548626  0.0615639053 -0.03843283 -0.03582926  0.063118577
[6,] 0.01118421 -0.0005861023  0.07010639  0.01689513  0.081836693
          [,637]      [,638]       [,639]     [,640]     [,641]
[1,]  0.03606339 -0.13619940 -0.051367376 0.10353312 0.07392192
[2,]  0.09408715 -0.08630372 -0.080650181 0.17458060 0.07599048
[3,]  0.04858595 -0.04637498 -0.080615312 0.07917575 0.01036839
[4,]  0.12021314 -0.15209834 -0.119823240 0.04993320 0.03411581
[5,]  0.02005794 -0.13674355  0.002104346 0.07433884 0.12297715
[6,] -0.03113093  0.04155017 -0.085316509 0.05384269 0.09085373
          [,642]      [,643]     [,644]      [,645]       [,646]
[1,]  0.01333701 -0.00582011 0.15713017 -0.05514756  0.044768147
[2,]  0.06772912 -0.04244962 0.11102190 -0.13224754  0.026957383
[3,]  0.02008614 -0.02806790 0.10794488 -0.14916168 -0.005188774
[4,]  0.04652314 -0.05789090 0.08634548 -0.07793872  0.094190098
[5,]  0.01489882 -0.12299080 0.10937995 -0.01534617  0.117422812
[6,] -0.05196442 -0.05412933 0.09008405 -0.04924094  0.063689373
          [,647]      [,648]       [,649]      [,650]       [,651]
[1,]  0.08581818  0.14838016 -0.067709140  0.02948107  0.085206084
[2,] -0.01263564  0.16454530 -0.053092696 -0.03030418 -0.033222977
[3,] -0.01956559  0.04567408  0.006813697 -0.03798756  0.004434918
[4,]  0.13683076 -0.11759794  0.035414111  0.06610941  0.062410619
[5,]  0.16712075 -0.05554906  0.101892747  0.07900701  0.012045181
[6,]  0.02136588  0.25598088 -0.050038930  0.04889823  0.038526274
         [,652]      [,653]      [,654]     [,655]      [,656]
[1,] 0.33459133 -0.19480552 -0.10066294 0.03892896 -0.08909143
[2,] 0.19124396  0.07472620  0.07023271 0.03579077 -0.03493149
[3,] 0.09335737 -0.07692355  0.07608291 0.03562872  0.06468541
[4,] 0.14920172 -0.32679296  0.04796868 0.02999353 -0.08332895
[5,] 0.09121822 -0.18201549  0.01287561 0.15056956  0.03620177
[6,] 0.08416826 -0.10758856  0.08227087 0.01508947 -0.18300064
          [,657]       [,658]     [,659]       [,660]       [,661]
[1,] -0.05931152 -0.172557011 0.04345829 -0.092010327  0.009216376
[2,]  0.11495795  0.022532800 0.04255837  0.003888385 -0.017729213
[3,]  0.10427144  0.003396329 0.08324926 -0.074082427 -0.050252728
[4,]  0.26004377 -0.111642517 0.06373667 -0.034114234  0.046861809
[5,]  0.17605624 -0.184327334 0.10711108 -0.005935872  0.078089602
[6,] -0.01360951 -0.066098414 0.06643615 -0.034024406 -0.035054497
           [,662]     [,663]      [,664]    [,665]      [,666]
[1,]  0.026112964 0.04457451 -0.08195589 0.3652456  0.06814873
[2,] -0.084683232 0.20700213 -0.08401885 0.2779030  0.07222094
[3,] -0.041739639 0.16441514 -0.13062321 0.1978280  0.08606069
[4,]  0.006917433 0.01766723  0.12383654 0.3698117  0.14708796
[5,]  0.139725775 0.01032029 -0.12477722 0.8141871 -0.04375590
[6,] -0.119117558 0.09434055  0.01547983 0.5833461  0.07563126
          [,667]      [,668]     [,669]      [,670]       [,671]
[1,] -0.18481112 -0.10735333 0.05807753 0.149984196 -0.023577670
[2,] -0.05562754 -0.05690396 0.05784097 0.006915372  0.020710021
[3,] -0.10250952 -0.09087744 0.01515261 0.026762316  0.006017368
[4,] -0.14188011 -0.02832006 0.08038715 0.124325506 -0.021963054
[5,] -0.15972200  0.05010274 0.12669383 0.088621408  0.195333421
[6,] -0.06781326 -0.15493165 0.03824890 0.026009392  0.147379860
          [,672]     [,673]     [,674]      [,675]      [,676]
[1,] -0.09994625 0.05075474 0.13770406 -0.05091312 -0.04950824
[2,] -0.09429576 0.31762967 0.09407511  0.03314918  0.04867224
[3,] -0.10170484 0.17788664 0.01901637  0.07297327  0.03511119
[4,] -0.10722709 0.13335045 0.16321246 -0.11654978  0.04190560
[5,] -0.06281777 0.10059397 0.23034173 -0.08462723  0.04426360
[6,] -0.19650432 0.24314374 0.04436253  0.06214135  0.04953858
         [,677]      [,678]       [,679]     [,680]    [,681]
[1,] 0.16101447  0.03261756  0.005240528 0.17729074 0.1418883
[2,] 0.08751366 -0.07091376  0.044283517 0.04682508 0.1179714
[3,] 0.05827320 -0.01815493  0.062092572 0.07742473 0.1240227
[4,] 0.17231475 -0.07104249  0.001609321 0.15648434 0.1138151
[5,] 0.16983619 -0.10041435 -0.032318529 0.12371835 0.1463693
[6,] 0.17711435 -0.02248377  0.033749245 0.10109564 0.1119698
           [,682]       [,683]      [,684]      [,685]      [,686]
[1,] -0.049148161 -0.102843538 -0.06435385  0.03377604 -0.12738264
[2,] -0.110841155  0.005716325 -0.10358587 -0.14668216 -0.06658430
[3,] -0.062345993  0.025146997 -0.05186344 -0.11892558 -0.08773232
[4,] -0.006465571 -0.008823811  0.01966340 -0.04686633 -0.08963613
[5,] -0.018102204 -0.011661214 -0.05419477 -0.01541439 -0.02234121
[6,] -0.046921309 -0.093011886 -0.03803139 -0.08654918 -0.10063978
         [,687]      [,688]       [,689]      [,690]      [,691]
[1,] 0.01920767 -0.01419010 -0.036548067  0.10385793 -0.11925840
[2,] 0.04427815 -0.02267865 -0.003029384  0.27559093 -0.07172565
[3,] 0.04829218 -0.10402574 -0.074470729  0.21307336 -0.04934324
[4,] 0.12816328  0.01964043 -0.015710143 -0.05150509 -0.11027411
[5,] 0.16518584 -0.06116838 -0.023354217  0.12244792 -0.17023247
[6,] 0.05208472 -0.14492629 -0.004217244  0.20259228 -0.14674774
          [,692]     [,693]      [,694]       [,695]       [,696]
[1,]  0.12935558 0.08585732 -0.15259826 -0.064426281  0.009427316
[2,]  0.03327186 0.10031641 -0.12604305 -0.060223628 -0.059971269
[3,] -0.03249951 0.09358674 -0.02737276 -0.052089132 -0.034287207
[4,]  0.10765537 0.04947363 -0.18106559 -0.174612015  0.017920753
[5,]  0.05951141 0.13333648 -0.16659611 -0.220832214 -0.016421426
[6,] -0.01870032 0.08445355 -0.05548840 -0.009819379  0.009299650
         [,697]       [,698]      [,699]     [,700]      [,701]
[1,] 0.07498431  0.008924695 -0.03596460 0.02562026  0.05723343
[2,] 0.08413466 -0.003248119 -0.02388706 0.06124064  0.09032298
[3,] 0.02059310  0.011218891 -0.03507020 0.03977913  0.02634757
[4,] 0.08082996 -0.004628158 -0.07882575 0.19233127 -0.02707683
[5,] 0.04945038  0.018265825  0.06390458 0.17153908  0.04357209
[6,] 0.15937333  0.014907548 -0.03504714 0.01345458  0.01027399
          [,702]     [,703]       [,704]        [,705]     [,706]
[1,]  0.05042209 0.17513010  0.078270368  0.0009879635 0.07609536
[2,]  0.01899258 0.10236545 -0.003082412  0.0433276631 0.03979125
[3,] -0.01377380 0.09460923  0.039820436  0.0470335819 0.03629850
[4,] -0.07509898 0.09751321  0.005451262 -0.0174586307 0.06780927
[5,]  0.04036519 0.05327782 -0.020448197 -0.0222254954 0.04950605
[6,]  0.00286444 0.20329627  0.061935090  0.0600249246 0.01128719
         [,707]       [,708]      [,709]       [,710]       [,711]
[1,] 0.08480427 -0.051488783 -0.15092826  0.040600438  0.021364078
[2,] 0.11551305 -0.089709833 -0.09235039  0.054773681 -0.051684495
[3,] 0.04133570 -0.007567647 -0.13295510  0.086913794 -0.010189838
[4,] 0.13612410 -0.022304114 -0.14579950  0.052552368  0.006682473
[5,] 0.13363947 -0.084428973 -0.14787699 -0.033316150 -0.034028500
[6,] 0.10874654 -0.010607310 -0.07875548 -0.002926263  0.017746029
           [,712]     [,713]      [,714]      [,715]       [,716]
[1,]  0.055909742 0.13373113 0.010450879 -0.07233977  0.049532827
[2,]  0.044699516 0.05596512 0.017389840 -0.01976865 -0.060050644
[3,] -0.003019668 0.09866080 0.008203694 -0.04194739  0.033643007
[4,]  0.106271528 0.10256605 0.050474018 -0.10010678 -0.096137635
[5,]  0.134674683 0.03579661 0.262081206 -0.02019673 -0.058704950
[6,]  0.018991491 0.07984170 0.046879679 -0.13486291 -0.004231149
          [,717]      [,718]      [,719]     [,720]    [,721]
[1,] -0.15207241  0.01589682 -0.07201874 0.12655738 0.2714218
[2,] -0.14243512 -0.06132271 -0.08397345 0.05954942 0.2686446
[3,] -0.11367873  0.01625160 -0.06947573 0.13009270 0.2074144
[4,] -0.01131313  0.01650861 -0.16232024 0.12199844 0.3521203
[5,] -0.20922038  0.07140674  0.07200902 0.14064504 0.2851988
[6,] -0.18501478  0.01336365 -0.18002975 0.08586299 0.2361627
          [,722]    [,723]       [,724]     [,725]     [,726]
[1,] -0.04793752 0.1239760 -0.042619105 0.07675026 0.04989492
[2,] -0.03580271 0.2204790  0.028894657 0.07819990 0.03738726
[3,] -0.04341270 0.1997167  0.009197655 0.10368587 0.06880984
[4,] -0.01400930 0.1125405 -0.013918034 0.10096098 0.07105603
[5,] -0.03376498 0.2289448 -0.006609058 0.08865908 0.02157804
[6,] -0.09421291 0.2373826 -0.087017901 0.13768604 0.07877830
         [,727]      [,728]      [,729]        [,730]       [,731]
[1,] 0.11111774  0.12066169 -0.08823191 -0.0968144462 -0.003828065
[2,] 0.09153498  0.01680492  0.05834011 -0.1283439696 -0.086855493
[3,] 0.02735950  0.01842253  0.05487081 -0.0598209202 -0.041060273
[4,] 0.15378579  0.08465433 -0.09540128 -0.0794036761 -0.066965066
[5,] 0.22088622  0.12059090 -0.18659893 -0.0002434805  0.124148265
[6,] 0.01092780 -0.05189246 -0.05732826 -0.0068929754 -0.059818584
         [,732]       [,733]      [,734]      [,735]     [,736]
[1,] -1.0205674 -0.012650539 -0.07955996 -0.19061120 0.24889600
[2,] -1.6376132 -0.027073890 -0.11495793  0.02188260 0.27936694
[3,] -1.3168830  0.028417423 -0.15257415  0.01262438 0.11415002
[4,] -0.8893182 -0.003889868 -0.03194398 -0.10278581 0.14121774
[5,] -1.3300040 -0.001954583 -0.11487593 -0.01644935 0.06424145
[6,] -1.0931637  0.005661166 -0.04133619 -0.03086518 0.11152110
           [,737]      [,738]      [,739]       [,740]       [,741]
[1,] -0.003787148 -0.02626314 -0.05684900 -0.030116322  0.019574083
[2,]  0.031762563 -0.19462261  0.03391609 -0.065266207  0.010448777
[3,] -0.028514821 -0.09818638  0.05229101 -0.056107655 -0.002290886
[4,] -0.013125353 -0.09966719 -0.01316734 -0.062725045  0.047559965
[5,]  0.006487907 -0.21648905 -0.03054102 -0.003993882 -0.035927922
[6,]  0.143368512 -0.06219042  0.01643150  0.027760662  0.167845950
           [,742]      [,743]     [,744]      [,745]     [,746]
[1,] -0.006300187  0.11072528 0.06599118 0.104969658 0.11591630
[2,]  0.039824650  0.11417527 0.07130589 0.086033270 0.07507633
[3,] -0.046479836  0.07696974 0.11749076 0.069948621 0.07018101
[4,]  0.001496303  0.11861439 0.06500278 0.093097188 0.08963138
[5,] -0.009119453 -0.01157343 0.12341224 0.069648638 0.06475202
[6,] -0.055967491  0.04665795 0.05940204 0.004410517 0.11607914
           [,747]      [,748]      [,749]    [,750]     [,751]
[1,] -0.005869865 -0.09371068 -0.07998058 0.5072689 0.15181084
[2,] -0.013162416 -0.08033861 -0.08842883 0.4089560 0.18010509
[3,] -0.030671582 -0.08326717 -0.20276427 0.3482460 0.08906674
[4,] -0.036494512 -0.02704215  0.01600152 0.2208505 0.13019434
[5,]  0.059290923 -0.02641463 -0.26967326 0.1779452 0.25794142
[6,]  0.017716359 -0.08491317 -0.08338597 0.4885524 0.10065948
         [,752]     [,753]       [,754]       [,755]       [,756]
[1,] -0.2158261 0.05548894  0.006289285 -0.021548092 -0.012992766
[2,] -0.1794356 0.16941381  0.060302734  0.026785025  0.017900588
[3,] -0.2917365 0.14918669  0.006558592  0.059029546  0.060162686
[4,] -0.2923160 0.05454070  0.049739074 -0.055772901  0.020266797
[5,] -0.3163047 0.04446334 -0.182113379 -0.017461553 -0.096357614
[6,] -0.2533574 0.23800616  0.053148732  0.007075642  0.005899848
           [,757]     [,758]      [,759]      [,760]       [,761]
[1,] -0.004315879 0.08018567 -0.16251971 -0.12237902 -0.099664904
[2,]  0.021114955 0.01345702 -0.12080519 -0.06235048  0.159044981
[3,]  0.024573060 0.07193569 -0.06111015 -0.04808743 -0.002424658
[4,]  0.051165286 0.05130168 -0.16208030 -0.12310728 -0.090935059
[5,] -0.124562979 0.13982485 -0.18622497 -0.12187486 -0.046656270
[6,]  0.037395142 0.01761835 -0.05774543 -0.06053047  0.041841812
          [,762]    [,763]    [,764]      [,765]        [,766]
[1,] -0.06233726 0.1447253 0.1683183 -0.19668962  0.0165074896
[2,] -0.04395547 0.2787576 0.1744189 -0.01972667  0.1150709465
[3,] -0.01668818 0.1851185 0.1324145  0.05224041 -0.0654691830
[4,]  0.02574161 0.1451475 0.1177684  0.06272639 -0.0085238395
[5,]  0.03204844 0.1277810 0.1642708 -0.14526126  0.0274618156
[6,] -0.07035222 0.1358655 0.1458258 -0.19299366  0.0009176398
           [,767]      [,768]
[1,]  0.067714356 -0.02958016
[2,] -0.040427078  0.03495659
[3,]  0.001104798  0.03656437
[4,]  0.010757907 -0.03644707
[5,]  0.004185256  0.02862171
[6,] -0.015431712  0.02789298

It took about 51 minutes on my computer. So, you may want to export these embeddings as an external file to save time. It is not a good idea to run this repeatedly every time we need these embeddings. So, you run it first and then export this embedding matrix as a .csv file. Whenever we need this matrix, we can just read them into our R environment instead of re-doing this analysis. Below, I am appending the target outcome to the embedding matrix, and then exporting them all as a .csv file.

read.embeddings <- as.data.frame(read.embeddings)
read.embeddings$target <- readability$target


write.csv(read.embeddings, 
          here('data/readability_features.csv'),
          row.names = FALSE)

Note that it takes significantly less time to compute sentence embeddings if you have access to computational resources with GPU. For instance, if you run the same analysis above on a Kaggle notebook with GPU turned on, it only takes 70 seconds. So, it is important to use GPU resources when using these models if you have access. You can check the associated Kaggle notebook for the analysis in this post.

https://www.kaggle.com/code/uocoeeds/lecture-2b-data-preprocessing-ii

Reuse

Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".