Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
f3330bb
Add correlation map to EDA
narnij Sep 25, 2020
4cc953d
Scott's edits to the correlation notebook, now renamed as MET2GCP_COR…
Sep 28, 2020
344df4d
add pvalues
narnij Oct 4, 2020
dc5fe1a
Merge branch 'rachaelj' of https://github.com/sriram-lab/egem into ra…
narnij Oct 4, 2020
4a7d565
add pvalue
narnij Oct 4, 2020
d9400b8
Delete metabolite_hm_corr_p.ipynb
narnij Oct 4, 2020
87eb620
Add server side
Oct 7, 2020
52d712f
resolve conflict
Oct 7, 2020
2085bbb
Merge branch 'master' of github.com:sriram-lab/egem into rachaelj
Oct 7, 2020
df87eca
modify function calculate_pvalues and variables' name, add docstring …
narnij Oct 7, 2020
22e207d
Merge branch 'rachaelj' of https://github.com/sriram-lab/egem into ra…
narnij Oct 7, 2020
2a1121a
add new function generate_corrtable that return correlations with p-v…
narnij Oct 7, 2020
62888c7
modify function generate_corrtable
narnij Oct 7, 2020
5cd82cc
add all
Oct 7, 2020
983564f
Added server-side scripts
Oct 7, 2020
3b5bf02
Merge branch 'rachaelj' of github.com:sriram-lab/egem into rachaelj
Oct 7, 2020
9012112
Add parallel processing
Oct 7, 2020
f4ad767
Merge branch 'master' into rachaelj
Oct 7, 2020
33d1378
modify function generate_corrtable to show only 1 and -1
narnij Oct 8, 2020
6b4e9f3
Merge branch 'rachaelj' of https://github.com/sriram-lab/egem into ra…
narnij Oct 8, 2020
26502ec
linear regression
narnij Jan 13, 2021
78b59cd
edit linear regression, add lasso
narnij Jan 15, 2021
0fd9644
change the evaluate_model function in Linear regression, and add mark…
narnij Feb 7, 2021
2a0e8f9
add .py version of MET2GCP, LASSO, and Linear regression
narnij Feb 9, 2021
2565915
to find correlation between individual histone marker and metabolites
narnij Mar 27, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
756 changes: 756 additions & 0 deletions src/python/EDA/.ipynb

Large diffs are not rendered by default.

Binary file added src/python/EDA/CCLE metabolomics dataset.xlsx
Binary file not shown.
867 changes: 867 additions & 0 deletions src/python/EDA/GCP_proteomics_remapped.csv

Large diffs are not rendered by default.

155,896 changes: 155,896 additions & 0 deletions src/python/EDA/LASSO.ipynb

Large diffs are not rendered by default.

10,346 changes: 10,346 additions & 0 deletions src/python/EDA/LASSO_correlation.ipynb

Large diffs are not rendered by default.

226 changes: 226 additions & 0 deletions src/python/EDA/Linear_regression.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,226 @@
,GCP2MET_p,GCP2MET_r,GCP2MET_r_0.05
0,0.15596101235631651,0.08841408170712407,
1,0.2683289819823082,0.06903242224474643,
2,4.13580524042827e-06,0.2816550268096376,0.2816550268096376
3,0.43845498472580147,0.04834973402136666,
4,0.48958378752706705,0.04312345731011802,
5,0.10561219473074844,0.10078347572841731,
6,0.04150202990258827,0.12676666662016062,0.12676666662016062
7,0.9405284155006844,0.004658281464585169,
8,5.072949592209412e-08,0.3305993642096282,0.3305993642096282
9,0.4756190074780041,0.04451979555199381,
10,0.7940258840497885,0.0163008886119214,
11,7.564639555110568e-06,0.2741733985937681,0.2741733985937681
12,0.006061612319241815,0.17010874599466366,0.17010874599466366
13,3.6394410660969657e-07,0.30977429960255487,0.30977429960255487
14,0.0002590493406188238,0.22516265826268486,0.22516265826268486
15,0.00519577520957138,0.17317412998361387,0.17317412998361387
16,0.7916807740000481,-0.016490806855416956,
17,0.42584785368987194,0.049690503644800064,
18,8.32400983380631e-05,0.24202701455935596,0.24202701455935596
19,0.15849882164496704,0.08787719939948853,
20,0.0008390412715381138,0.2062732714293588,0.2062732714293588
21,0.6001061336999053,0.03272474222601174,
22,0.09803587966127486,0.10302719616756181,
23,8.362941171456056e-06,0.2729087635036128,0.2729087635036128
24,0.3309481375923274,0.06064766049027262,
25,0.0008875552319947536,0.2053277048700342,0.2053277048700342
26,0.14500948194361105,0.09080968694555822,
27,0.8421944227088326,-0.012430333147194463,
28,0.32232745094052645,-0.06173605538886858,
29,0.10030945722181463,0.10233986712018119,
30,0.0008181175159394652,0.2066967394581407,0.2066967394581407
31,0.41668978415748015,0.05067895079521502,
32,0.028638775784227855,0.1360074013263466,0.1360074013263466
33,0.6673863023642659,-0.026827572678882437,
34,0.0005104033946532644,0.21446010960348144,0.21446010960348144
35,9.732338366393351e-05,0.23977618909749301,0.23977618909749301
36,0.04480782560043395,0.12479083900277593,0.12479083900277593
37,0.061697580935414324,0.11626896593409813,
38,0.0063910668264401315,0.16904477991609637,0.16904477991609637
39,0.615374517410182,-0.03136266749960741,
40,0.060223051992684386,0.116929874868366,
41,0.02114934594290931,0.1431984857169866,0.1431984857169866
42,2.3505137133291225e-07,0.3145331133808589,0.3145331133808589
43,0.05107231330175686,0.12135986509530977,
44,0.034457784665787056,0.1314644978752118,0.1314644978752118
45,0.3825528172192555,0.054481367886225915,
46,0.3549898502648134,0.057705056117661,
47,1.0573614211410752e-05,0.26992730263776954,0.26992730263776954
48,0.1067894266066992,-0.10044635152440859,
49,0.013834758249558677,0.1527916812280568,0.1527916812280568
50,0.07125328127952708,0.11227481896125469,
51,0.0084782125519347,0.16326063007134164,0.16326063007134164
52,0.042623742018105794,0.12608186609340066,0.12608186609340066
53,0.48400404843733236,0.0436787624391302,
54,0.06851647352658394,0.11337158278612806,
55,0.01952108908459176,0.14504974500878248,0.14504974500878248
56,0.010828174062519607,0.15810479547750728,0.15810479547750728
57,0.017778006862024846,0.14718658593077716,0.14718658593077716
58,0.5069503826758475,-0.04141634154926799,
59,0.10593391036744602,0.10069105296035522,
60,0.4111095806620824,0.05128748228848348,
61,0.01726176122218483,0.1478544719951586,0.1478544719951586
62,0.008800264269886802,0.16248411598905327,0.16248411598905327
63,0.9738342479406774,-0.002047983591821366,
64,0.007219804832293508,0.16657086106490548,0.16657086106490548
65,0.1421405900464953,0.09145988811974223,
66,0.0504545892233836,0.12168205521402956,
67,1.3474319032643662e-05,0.2668082660593777,0.2668082660593777
68,0.03661738746325065,0.1299439899274829,0.1299439899274829
69,5.192097865857052e-05,0.24869730090213021,0.24869730090213021
70,0.0012665767734938568,0.1992469482626063,0.1992469482626063
71,0.018417948903039685,0.14638173282213196,0.14638173282213196
72,0.06591975513225576,0.11444581810477542,
73,0.0013002666120890502,0.19879106891519718,0.19879106891519718
74,0.018415650773259285,0.14638457932679677,0.14638457932679677
75,0.004059354454703298,0.17798445799342877,0.17798445799342877
76,0.8124330579069723,-0.014815236075386016,
77,0.029215201313260723,0.13552387248266914,0.13552387248266914
78,0.1980120394298471,0.08024405283554217,
79,0.12026880206183231,0.09678026266303016,
80,0.0409362631725084,0.1271179938823049,0.1271179938823049
81,0.9665398908294806,0.0026192068833453437,
82,0.007978444507876783,0.16451920820307966,0.16451920820307966
83,0.004695843739259663,0.17516013809930223,0.17516013809930223
84,0.012754328262315553,0.1545721027683497,0.1545721027683497
85,0.04139418909849767,0.12683332069743009,0.12683332069743009
86,0.7873336267363054,0.016843262772666276,
87,0.055006623712599456,0.11938063530675919,
88,0.012823711323983975,0.15445385744608675,0.15445385744608675
89,0.06370417290196785,0.11539014638558848,
90,0.09698384587586344,0.103349528624296,
91,9.334229579184493e-05,0.24037971062066832,0.24037971062066832
92,6.182143872340265e-05,0.2462525543622664,0.2462525543622664
93,0.010060964412686653,0.1596686355377826,0.1596686355377826
94,0.12880407273055,0.09462162549679001,
95,0.0839537437757712,0.10759314139291923,
96,0.2519434985358215,0.07144126758208731,
97,0.09074326232860193,0.10532100083786564,
98,0.6378315436045114,0.02938573529982645,
99,0.015250132649091093,0.15063549808052024,0.15063549808052024
100,0.3796707173015079,0.054811606626310475,
101,0.311635716142464,0.06311250669772403,
102,0.03015146255378101,0.13475561685862303,0.13475561685862303
103,0.0011015205602114663,0.20165529529957799,0.20165529529957799
104,0.5323263091341442,0.038975761631193734,
105,1.0839811922747446e-05,0.2696091756969605,0.2696091756969605
106,0.968941239862182,0.0024311347822542385,
107,0.0010173787854351147,0.20301380148850567,0.20301380148850567
108,0.038309482625675434,0.12880485323275792,0.12880485323275792
109,0.05946851222635137,0.11727324466719985,
110,0.0020074412869660026,0.1911014085878685,0.1911014085878685
111,0.7710172773693086,0.018171025998217794,
112,0.007704826138662918,0.16523830692899233,0.16523830692899233
113,0.25156264196169237,0.07149852636533344,
114,0.00372042277992737,0.17965588138525745,0.17965588138525745
115,0.0002779939380895606,0.22407227229737509,0.22407227229737509
116,0.7982203629263932,0.015961572033037615,
117,0.13656144252612978,0.0927536074642857,
118,0.03410138915771258,0.13172315792746064,0.13172315792746064
119,0.3456575179779387,0.05883180764436289,
120,0.6321882079858759,0.029879700640912506,
121,0.7889120229241636,0.01671522919300728,
122,0.7544690601880587,0.019526060435241674,
123,0.34143349002402473,0.059348130350861075,
124,0.7124648630951598,-0.023008702658974225,
125,0.9696800832861593,0.0023732735335636815,
126,0.8579354730340353,-0.011176408135375872,
127,0.5078122050739483,0.041332433466552305,
128,0.9169588982093178,0.006510144925023954,
129,0.9496262182597837,-0.003944641371380109,
130,0.5765568117491989,-0.034856659278632914,
131,0.9397342430003383,0.004720604472835038,
132,0.1319941706001005,0.09384321859079739,
133,0.5799087784715765,-0.03455078436298269,
134,0.019666173456314412,0.14487946010711938,0.14487946010711938
135,0.014491967275033216,0.15176755114818105,0.15176755114818105
136,0.2603027849554402,0.07019931889582971,
137,0.2226486889281362,0.07603502957181371,
138,0.010561760974605448,0.1586364015068884,0.1586364015068884
139,0.04517568828017788,0.1245786124722073,0.1245786124722073
140,0.01852359354652035,0.1462512119297757,0.1462512119297757
141,0.2065882922676511,0.07873811524082935,
142,0.017408271545806844,0.14766317586693184,0.14766317586693184
143,0.7398923767171517,0.020727261019048253,
144,0.0002999279496076135,0.22289315316859126,0.22289315316859126
145,0.34053538356464774,0.05945843278521548,
146,0.06353833405351028,0.11546190902145032,
147,0.02240290140077534,0.14185559424915195,0.14185559424915195
148,0.00011061384125312457,0.237916797549408,0.237916797549408
149,0.0009325622156453431,0.20449215870042117,0.20449215870042117
150,0.007491324661970052,0.16581539106490506,0.16581539106490506
151,0.3782410035238733,0.054975995566989906,
152,0.004728269774484887,0.17502568811330058,0.17502568811330058
153,0.24568054840620324,0.07239059923840628,
154,0.18389106751489162,0.08283061807044811,
155,0.7431569230133517,0.020457596022925875,
156,0.047365318926873144,0.12334450942462527,0.12334450942462527
157,0.1178227170986685,0.09742079676728976,
158,0.02321706599325786,0.14101780485220708,0.14101780485220708
159,0.6960085088561925,0.02439217072659124,
160,0.175504786551826,0.08443661443495895,
161,0.5095796083438688,0.04116058893799214,
162,0.018143752399641905,0.1467235597390352,0.1467235597390352
163,0.0006621099254957032,0.2102123290653007,0.2102123290653007
164,0.011720386451562167,0.15640484064649346,0.15640484064649346
165,0.9313885068776596,0.00537583423996337,
166,0.04134267388167358,0.1268652127557216,0.1268652127557216
167,0.07660462581780036,0.11022583606068928,
168,0.6997885103859766,0.024073359199193678,
169,0.7306504924338824,-0.021492787306168257,
170,0.09000692381504657,0.10556069639069866,
171,0.24528574412798712,0.07245100499890718,
172,0.894642426652994,0.008268793664716676,
173,0.35284877210492815,0.05796189690676056,
174,0.08395796928508652,0.10759168212992617,
175,0.012007053541815225,0.155882865895776,0.155882865895776
176,0.5803187098969057,0.034513433867378825,
177,0.10789770709240044,0.10013163824973784,
178,0.00032209816387142234,0.22178026921900723,0.22178026921900723
179,0.33958899025297457,0.059574866326272354,
180,0.11769686912538276,0.09745403081416813,
181,0.028490973680278652,0.1361327247290445,0.1361327247290445
182,0.0001121385111971435,0.2377170712614345,0.2377170712614345
183,1.085205436350078e-05,0.26959472404036555,0.26959472404036555
184,0.0015208728194408298,0.19604882615874647,0.19604882615874647
185,1.626283641919027e-05,0.2643611747772854,0.2643611747772854
186,0.00012129948816860713,0.23656807764470067,0.23656807764470067
187,0.10494142851904661,0.10097689052724658,
188,6.382057636952492e-05,0.2458040494714529,0.2458040494714529
189,7.768154468485725e-05,0.24301542025496192,0.24301542025496192
190,0.000171609352860436,0.23142258197423063,0.23142258197423063
191,0.009164282032346583,0.16163623714577563,0.16163623714577563
192,0.06906769166997863,0.11314784473221966,
193,0.00030107657290266016,0.22283364299756284,0.22283364299756284
194,0.001863552985207064,0.19243868983705198,0.19243868983705198
195,0.7327868055865551,0.021315550062052484,
196,0.01975698244368223,0.14477343218525018,0.14477343218525018
197,4.5035466561078385e-05,0.25067201759644797,0.25067201759644797
198,0.017112388821587367,0.1480509681876337,0.1480509681876337
199,0.19310272741498766,0.08112753714582227,
200,0.01322488689513917,0.15378099006306475,0.15378099006306475
201,0.010920665799272072,0.1579229369041494,0.1579229369041494
202,0.04343951237233766,0.12559329645954898,0.12559329645954898
203,0.29699319275026564,0.06504882698902073,
204,0.5705760095973987,0.03540450325648764,
205,0.6217007060940701,0.03080267507789853,
206,0.06170117027993664,0.11626737307066493,
207,0.05822517554866921,0.11784697479706323,
208,0.3249761720031785,0.06139966300511841,
209,0.006971163480890482,0.16728524845677945,0.16728524845677945
210,0.356455775594504,0.057529766006664,
211,0.6113339783515341,0.03172165026323853,
212,0.4796054974248857,0.0441189500848891,
213,0.08809350400001988,0.10619098158640856,
214,0.10647139343586658,0.10053713682207777,
215,0.0007084928134123224,0.20909344994685303,0.20909344994685303
216,0.0514450815977261,0.12116700442010739,
217,0.0010750313098667429,0.20207237065846462,0.20207237065846462
218,0.06110189635931056,0.11653437913691499,
219,0.0547452581228565,0.11950841254407231,
220,0.08479834120761068,0.10730263048240564,
221,0.021869065201684575,0.14241931927398524,0.14241931927398524
222,0.005282124228201892,0.17284863402051104,0.17284863402051104
223,0.4823743862055355,0.04384159865743759,
224,0.0019536938633485435,0.19159037423480568,0.19159037423480568
Loading