-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathFOOTER
More file actions
executable file
·4361 lines (3977 loc) · 205 KB
/
Copy pathFOOTER
File metadata and controls
executable file
·4361 lines (3977 loc) · 205 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
================================================================
to download all of the files from one of these admin/exe/ directories,
for example: admin/exe/linux.x86_64/
using the rsync command to your current directory:
rsync -aP rsync://hgdownload.cse.ucsc.edu/genome/admin/exe/linux.x86_64/ ./
================================================================
======== addCols ====================================
================================================================
addCols - Sum columns in a text file.
usage:
addCols <fileName>
adds all columns (up to 16 columns) in the given file,
outputs the sum of each column. <fileName> can be the
name: stdin to accept input from stdin.
================================================================
======== ameme ====================================
================================================================
ameme - find common patterns in DNA
usage
ameme good=goodIn.fa [bad=badIn.fa] [numMotifs=2] [background=m1] [maxOcc=2] [motifOutput=fileName] [html=output.html] [gif=output.gif] [rcToo=on] [controlRun=on] [startScanLimit=20] [outputLogo] [constrainer=1]
where goodIn.fa is a multi-sequence fa file containing instances
of the motif you want to find, badIn.fa is a file containing similar
sequences but lacking the motif, numMotifs is the number of motifs
to scan for, background is m0,m1, or m2 for various levels of Markov
models, maxOcc is the maximum occurrences of the motif you
expect to find in a single sequence and motifOutput is the name
of a file to store just the motifs in. rcToo=on searches both strands.
If you include controlRun=on in the command line, a random set of
sequences will be generated that match your foreground data set in size,
and your background data set in nucleotide probabilities. The program
will then look for motifs in this random set. If the scores you get in a
real run are about the same as those you get in a control run, then the motifs
Improbizer has found are probably not significant.
================================================================
======== autoDtd ====================================
================================================================
autoDtd - Give this a XML document to look at and it will come up with a DTD
to describe it.
usage:
autoDtd in.xml out.dtd out.stats
options:
-tree=out.tree - Output tag tree.
-atree=out.atree - Output attributed tag tree.
================================================================
======== autoSql ====================================
================================================================
autoSql - create SQL and C code for permanently storing
a structure in database and loading it back into memory
based on a specification file
usage:
autoSql specFile outRoot {optional: -dbLink -withNull -json}
This will create outRoot.sql outRoot.c and outRoot.h based
on the contents of specFile.
options:
-dbLink - optionally generates code to execute queries and
updates of the table.
-addBin - Add an initial bin field and index it as (chrom,bin)
-withNull - optionally generates code and .sql to enable
applications to accept and load data into objects
with potential 'missing data' (NULL in SQL)
situations.
-defaultZeros - will put zero and or empty string as default value
-django - generate method to output object as django model Python code
-json - generate method to output the object in JSON (JavaScript) format.
================================================================
======== autoXml ====================================
================================================================
autoXml - Generate structures code and parser for XML file from DTD-like spec
usage:
autoXml file.dtdx root
This will generate root.c, root.h
options:
-textField=xxx what to name text between start/end tags. Default 'text'
-comment=xxx Comment to appear at top of generated code files
-picky Generate parser that rejects stuff it doesn't understand
-main Put in a main routine that's a test harness
-prefix=xxx Prefix to add to structure names. By default same as root
-positive Don't write out optional attributes with negative values
================================================================
======== ave ====================================
================================================================
ave - Compute average and basic stats
usage:
ave file
options:
-col=N Which column to use. Default 1
-tableOut - output by columns (default output in rows)
-noQuartiles - only calculate min,max,mean,standard deviation
- for large data sets that will not fit in memory.
================================================================
======== aveCols ====================================
================================================================
aveCols - average together columns
usage:
aveCols file
adds all columns (up to 16 columns) in the given file,
outputs the average (sum/#ofRows) of each column. <fileName> can be the
name: stdin to accept input from stdin.
================================================================
======== axtChain ====================================
================================================================
axtChain - Chain together axt alignments.
usage:
axtChain [options] -linearGap=loose in.axt tNibDir qNibDir out.chain
Where tNibDir/qNibDir are either directories full of nib files, the name
of a .2bit file, or a single fasta file with additional -faQ or -faT options.
options:
-psl Use psl instead of axt format for input
-faQ The specified qNibDir is a fasta file with multiple sequences for query
-faT The specified tNibDir is a fasta file with multiple sequences for target
NOTE: will not work with gzipped fasta files
-minScore=N Minimum score for chain, default 1000
-details=fileName Output some additional chain details
-scoreScheme=fileName Read the scoring matrix from a blastz-format file
-linearGap=<medium|loose|filename> Specify type of linearGap to use.
*Must* specify this argument to one of these choices.
loose is chicken/human linear gap costs.
medium is mouse/human linear gap costs.
Or specify a piecewise linearGap tab delimited file.
sample linearGap file (loose)
tablesize 11
smallSize 111
position 1 2 3 11 111 2111 12111 32111 72111 152111 252111
qGap 325 360 400 450 600 1100 3600 7600 15600 31600 56600
tGap 325 360 400 450 600 1100 3600 7600 15600 31600 56600
bothGap 625 660 700 750 900 1400 4000 8000 16000 32000 57000
================================================================
======== axtSort ====================================
================================================================
axtSort - Sort axt files
usage:
axtSort in.axt out.axt
options:
-query - Sort by query position, not target
-byScore - Sort by score
================================================================
======== axtSwap ====================================
================================================================
axtSwap - Swap source and query in an axt file
usage:
axtSwap source.axt target.sizes query.sizes dest.axt
options:
-xxx=XXX
================================================================
======== axtToMaf ====================================
================================================================
axtToMaf - Convert from axt to maf format
usage:
axtToMaf in.axt tSizes qSizes out.maf
Where tSizes and qSizes is a file that contains
the sizes of the target and query sequences.
Very often this with be a chrom.sizes file
Options:
-qPrefix=XX. - add XX. to start of query sequence name in maf
-tPrefex=YY. - add YY. to start of target sequence name in maf
-tSplit Create a separate maf file for each target sequence.
In this case output is a dir rather than a file
In this case in.maf must be sorted by target.
-score - recalculate score
-scoreZero - recalculate score if zero
================================================================
======== axtToPsl ====================================
================================================================
axtToPsl - Convert axt to psl format
usage:
axtToPsl in.axt tSizes qSizes out.psl
Where tSizes and qSizes are tab-delimited files with
<seqName><size>
columns.
options:
-xxx=XXX
================================================================
======== bedClip ====================================
================================================================
bedClip - Remove lines from bed file that refer to off-chromosome places.
usage:
bedClip input.bed chrom.sizes output.bed
chrom.sizes is a two-column file/URL: <chromosome name> <size in bases>
If the assembly <db> is hosted by UCSC, chrom.sizes can be a URL like
http://hgdownload.cse.ucsc.edu/goldenPath/<db>/bigZips/<db>.chrom.sizes
or you may use the script fetchChromSizes to download the chrom.sizes file.
If not hosted by UCSC, a chrom.sizes file can be generated by running
twoBitInfo on the assembly .2bit file.
options:
-verbose=2 - set to get list of lines clipped and why
================================================================
======== bedCommonRegions ====================================
================================================================
bedCommonRegions - Create a bed file (just bed3) that contains the regions common to all inputs.
Regions are common only if exactly the same chromosome, starts, and end. Overlap is not enough.
Each region must be in each input at most once. Output is stdout.
usage:
bedCommonRegions file1 file2 file3 ... fileN
================================================================
======== bedCoverage ====================================
================================================================
bedCoverage - Analyse coverage by bed files - chromosome by
chromosome and genome-wide.
usage:
bedCoverage database bedFile
Note bed file must be sorted by chromosome
-restrict=restrict.bed Restrict to parts in restrict.bed
================================================================
======== bedExtendRanges ====================================
================================================================
bedExtendRanges - extend length of entries in bed 6+ data to be at least the given length,
taking strand directionality into account.
usage:
bedExtendRanges database length files(s)
options:
-host mysql host
-user mysql user
-password mysql password
-tab Separate by tabs rather than space
-verbose=N - verbose level for extra information to STDERR
example:
bedExtendRanges hg18 250 stdin
bedExtendRanges -user=genome -host=genome-mysql.cse.ucsc.edu hg18 250 stdin
will transform:
chr1 500 525 . 100 +
chr1 1000 1025 . 100 -
to:
chr1 500 750 . 100 +
chr1 775 1025 . 100 -
================================================================
======== bedGeneParts ====================================
================================================================
bedGeneParts - Given a bed, spit out promoter, first exon, or all introns.
usage:
bedGeneParts part in.bed out.bed
Where part is either 'exons' or 'firstExon' or 'introns' or 'promoter' or 'firstCodingSplice'
or 'secondCodingSplice'
options:
-proStart=NN - start of promoter relative to txStart, default -100
-proEnd=NN - end of promoter relative to txStart, default 50
================================================================
======== bedGraphPack ====================================
================================================================
bedGraphPack v1 - Pack together adjacent records representing same value.
usage:
bedGraphPack in.bedGraph out.bedGraph
The input needs to be sorted by chrom and this is checked. To put in a pipe
use stdin and stdout in the command line in place of file names.
================================================================
======== bedGraphToBigWig ====================================
================================================================
bedGraphToBigWig v 4 - Convert a bedGraph file to bigWig format.
usage:
bedGraphToBigWig in.bedGraph chrom.sizes out.bw
where in.bedGraph is a four column file in the format:
<chrom> <start> <end> <value>
and chrom.sizes is a two-column file/URL: <chromosome name> <size in bases>
and out.bw is the output indexed big wig file.
If the assembly <db> is hosted by UCSC, chrom.sizes can be a URL like
http://hgdownload.cse.ucsc.edu/goldenPath/<db>/bigZips/<db>.chrom.sizes
or you may use the script fetchChromSizes to download the chrom.sizes file.
If not hosted by UCSC, a chrom.sizes file can be generated by running
twoBitInfo on the assembly .2bit file.
The input bedGraph file must be sorted, use the unix sort command:
sort -k1,1 -k2,2n unsorted.bedGraph > sorted.bedGraph
options:
-blockSize=N - Number of items to bundle in r-tree. Default 256
-itemsPerSlot=N - Number of data points bundled at lowest level. Default 1024
-unc - If set, do not use compression.
================================================================
======== bedIntersect ====================================
================================================================
bedIntersect - Intersect two bed files
usage:
bed columns four(name) and five(score) are optional
bedIntersect a.bed b.bed output.bed
options:
-aHitAny output all of a if any of it is hit by b
-minCoverage=0.N min coverage of b to output match (or if -aHitAny, of a).
Not applied to 0-length items. Default 0.000010
-bScore output score from b.bed (must be at least 5 field bed)
-tab chop input at tabs not spaces
-allowStartEqualEnd Don't discard 0-length items of a or b
(e.g. point insertions)
================================================================
======== bedItemOverlapCount ====================================
================================================================
bedItemOverlapCount - count number of times a base is overlapped by the
items in a bed file. Output is bedGraph 4 to stdout.
usage:
sort bedFile.bed | bedItemOverlapCount [options] <database> stdin
To create a bigWig file from this data to use in a custom track:
sort -k1,1 bedFile.bed | bedItemOverlapCount [options] <database> stdin \
> bedFile.bedGraph
bedGraphToBigWig bedFile.bedGraph chrom.sizes bedFile.bw
where the chrom.sizes is obtained with the script: fetchChromSizes
See also:
http://genome-test.cse.ucsc.edu/~kent/src/unzipped/utils/userApps/fetchChromSizes
options:
-zero add blocks with zero count, normally these are ommitted
-bed12 expect bed12 and count based on blocks
Without this option, only the first three fields are used.
-max if counts per base overflows set to max (4294967295) instead of exiting
-outBounds output min/max to stderr
-chromSize=sizefile Read chrom sizes from file instead of database
sizefile contains two white space separated fields per line:
chrom name and size
-host=hostname mysql host used to get chrom sizes
-user=username mysql user
-password=password mysql password
Notes:
* You may want to separate your + and - strand
items before sending into this program as it only looks at
the chrom, start and end columns of the bed file.
* Program requires a <database> connection to lookup chrom sizes for a sanity
check of the incoming data. Even when the -chromSize argument is used
the <database> must be present, but it will not be used.
* The bed file *must* be sorted by chrom
* Maximum count per base is 4294967295. Recompile with new unitSize to increase this
================================================================
======== bedPileUps ====================================
================================================================
bedPileUps - Find (exact) overlaps if any in bed input
usage:
bedPileUps in.bed
Where in.bed is in one of the ascii bed formats.
The in.bed file must be sorted by chromosome,start,
to sort a bed file, use the unix sort command:
sort -k1,1 -k2,2n unsorted.bed > sorted.bed
Options:
-name - include BED name field 4 when evaluating uniqueness
-tab - use tabs to parse fields
-verbose=2 - show the location and size of each pileUp
================================================================
======== bedRemoveOverlap ====================================
================================================================
bedRemoveOverlap - Remove overlapping records from a (sorted) bed file. Gets rid of
`the smaller of overlapping records.
usage:
bedRemoveOverlap in.bed out.bed
options:
-xxx=XXX
================================================================
======== bedRestrictToPositions ====================================
================================================================
bedRestrictToPositions - Filter bed file, restricting to only ones that match chrom/start/ends specified in restrict.bed file.
usage:
bedRestrictToPositions in.bed restrict.bed out.bed
options:
-xxx=XXX
================================================================
======== bedSort ====================================
================================================================
bedSort - Sort a .bed file by chrom,chromStart
usage:
bedSort in.bed out.bed
in.bed and out.bed may be the same.
================================================================
======== bedToBigBed ====================================
================================================================
bedToBigBed v. 2.7 - Convert bed file to bigBed. (BigBed version: 4)
usage:
bedToBigBed in.bed chrom.sizes out.bb
Where in.bed is in one of the ascii bed formats, but not including track lines
and chrom.sizes is a two-column file/URL: <chromosome name> <size in bases>
and out.bb is the output indexed big bed file.
If the assembly <db> is hosted by UCSC, chrom.sizes can be a URL like
http://hgdownload.cse.ucsc.edu/goldenPath/<db>/bigZips/<db>.chrom.sizes
or you may use the script fetchChromSizes to download the chrom.sizes file.
If not hosted by UCSC, a chrom.sizes file can be generated by running
twoBitInfo on the assembly .2bit file.
The in.bed file must be sorted by chromosome,start,
to sort a bed file, use the unix sort command:
sort -k1,1 -k2,2n unsorted.bed > sorted.bed
Sorting must be case insensitive (LC_COLLATE=C).
options:
-type=bedN[+[P]] :
N is between 3 and 15,
optional (+) if extra "bedPlus" fields,
optional P specifies the number of extra fields. Not required, but preferred.
Examples: -type=bed6 or -type=bed6+ or -type=bed6+3
(see http://genome.ucsc.edu/FAQ/FAQformat.html#format1)
-as=fields.as - If you have non-standard "bedPlus" fields, it's great to put a definition
of each field in a row in AutoSql format here.
-blockSize=N - Number of items to bundle in r-tree. Default 256
-itemsPerSlot=N - Number of data points bundled at lowest level. Default 512
-unc - If set, do not use compression.
-tab - If set, expect fields to be tab separated, normally
expects white space separator.
-extraIndex=fieldList - If set, make an index on each field in a comma separated list
extraIndex=name and extraIndex=name,id are commonly used.
================================================================
======== bedToExons ====================================
================================================================
bedToExons - Split a bed up into individual beds.
One for each internal exon.
usage:
bedToExons originalBeds.bed splitBeds.bed
options:
-cdsOnly - Only output the coding portions of exons.
================================================================
======== bedToGenePred ====================================
================================================================
Too few arguments:
bedToGenePred - convert bed format files to genePred format
usage:
bedToGenePred bedFile genePredFile
Convert a bed file to a genePred file. If BED has at least 12 columns,
then a genePred with blocks is created. Otherwise single-exon genePreds are
created.
================================================================
======== bedToPsl ====================================
================================================================
Too few arguments:
bedToPsl - convert bed format files to psl format
usage:
bedToPsl chromSizes bedFile pslFile
Convert a BED file to a PSL file. This the result is an alignment.
It is intended to allow processing by tools that operate on PSL.
If the BED has at least 12 columns, then a PSL with blocks is created.
Otherwise single-exon PSLs are created.
Options:
-keepQuery - instead of creating a fake query, create PSL with identical query and
target specs. Useful if bed features are to be lifted with pslMap and one
wants to keep the source location in the lift result.
================================================================
======== bedWeedOverlapping ====================================
================================================================
bedWeedOverlapping - Filter out beds that overlap a 'weed.bed' file.
usage:
bedWeedOverlapping weeds.bed input.bed output.bed
options:
-maxOverlap=0.N - maximum overlapping ratio, default 0 (any overlap)
-invert - keep the overlapping and get rid of everything else
================================================================
======== bigBedInfo ====================================
================================================================
bigBedInfo - Show information about a bigBed file.
usage:
bigBedInfo file.bb
options:
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
-chroms - list all chromosomes and their sizes
-zooms - list all zoom levels and their sizes
-as - get autoSql spec
-extraIndex - list all the extra indexes
================================================================
======== bigBedNamedItems ====================================
================================================================
bigBedNamedItems - Extract item of given name from bigBed
usage:
bigBedNamedItems file.bb name output.bed
options:
-nameFile - if set, treat name parameter as file full of space delimited names
-field=fieldName - use index on field name, default is "name"
================================================================
======== bigBedSummary ====================================
================================================================
bigBedSummary - Extract summary information from a bigBed file.
usage:
bigBedSummary file.bb chrom start end dataPoints
Get summary data from bigBed for indicated region, broken into
dataPoints equal parts. (Use dataPoints=1 for simple summary.)
options:
-type=X where X is one of:
coverage - % of region that is covered (default)
mean - average depth of covered regions
min - minimum depth of covered regions
max - maximum depth of covered regions
-fields - print out information on fields in file.
If fields option is used, the chrom, start, end, dataPoints
parameters may be omitted
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
================================================================
======== bigBedToBed ====================================
================================================================
bigBedToBed v1 - Convert from bigBed to ascii bed format.
usage:
bigBedToBed input.bb output.bed
options:
-chrom=chr1 - if set restrict output to given chromosome
-start=N - if set, restrict output to only that over start
-end=N - if set, restict output to only that under end
-maxItems=N - if set, restrict output to first N items
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
================================================================
======== bigWigAverageOverBed ====================================
================================================================
bigWigAverageOverBed v2 - Compute average score of big wig over each bed, which may have introns.
usage:
bigWigAverageOverBed in.bw in.bed out.tab
The output columns are:
name - name field from bed, which should be unique
size - size of bed (sum of exon sizes
covered - # bases within exons covered by bigWig
sum - sum of values over all bases covered
mean0 - average over bases with non-covered bases counting as zeroes
mean - average over just covered bases
Options:
-stats=stats.ra - Output a collection of overall statistics to stat.ra file
-bedOut=out.bed - Make output bed that is echo of input bed but with mean column appended
-sampleAroundCenter=N - Take sample at region N bases wide centered around bed item, rather
than the usual sample in the bed item.
-minMax - include two additional columns containing the min and max observed in the area.
================================================================
======== bigWigCat ====================================
================================================================
bigWigCat v 4 - merge non-overlapping bigWig files
directly into bigWig format
usage:
bigWigCat out.bw in1.bw in2.bw ...
Where in*.bw is in big wig format
and out.bw is the output indexed big wig file.
options:
-itemsPerSlot=N - Number of data points bundled at lowest level. Default 1024
Note: must use wigToBigWig -fixedSummaries -keepAllChromosomes (perhaps in parallel cluster jobs) to create the input files.
Note: By non-overlapping we mean the entire span of each file, from first data point to last data point, must not overlap with that of other files.
================================================================
======== bigWigCluster ====================================
================================================================
bigWigCluster - Cluster bigWigs using a hacTree
usage:
bigWigCluster input.list chrom.sizes output.json output.tab
where: input.list is a list of bigWig file names
chrom.sizes is tab separated <chrom><size> for assembly for bigWigs
output.json is json formatted output suitable for graphing with D3
output.tab is tab-separated file of of items ordered by tree with the fields
label - label from -labels option or from file name with no dir or extention
pos - number from 0-1 representing position according to tree and distance
red - number from 0-255 representing recommended red component of color
green - number from 0-255 representing recommended green component of color
blue - number from 0-255 representing recommended blue component of color
path - file name from input.list including directory and extension
options:
-labels=fileName - label files from tabSeparated file with fields
path - path to bigWig file
label - a string with no tabs
-precalc=precalc.tab - tab separated file with <file1> <file2> <distance>
columns.
-threads=N - number of threads to use, default 10
-tmpDir=/tmp/path - place to put temp files, default current dir
================================================================
======== bigWigCorrelate ====================================
================================================================
bigWigCorrelate - Correlate bigWig files, optionally only on target regions.
usage:
bigWigCorrelate a.bigWig b.bigWig
or
bigWigCorrelate listOfFiles
options:
-restrict=restrict.bigBed - restrict correlation to parts covered by this file
-threshold=N.N - clip values to this threshold
-rootNames - if set just report the root (minus directory and suffix) of file
names when using listOfFiles
================================================================
======== bigWigInfo ====================================
================================================================
bigWigInfo - Print out information about bigWig file.
usage:
bigWigInfo file.bw
options:
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
-chroms - list all chromosomes and their sizes
-zooms - list all zoom levels and their sizes
-minMax - list the min and max on a single line
================================================================
======== bigWigMerge ====================================
================================================================
bigWigMerge v2 - Merge together multiple bigWigs into a single output bedGraph.
You'll have to run bedGraphToBigWig to make the output bigWig.
The signal values are just added together to merge them
usage:
bigWigMerge in1.bw in2.bw .. inN.bw out.bedGraph
options:
-threshold=0.N - don't output values at or below this threshold. Default is 0.0
-adjust=0.N - add adjustment to each value
-clip=NNN.N - values higher than this are clipped to this value
-inList - input file are lists of file names of bigWigs
================================================================
======== bigWigSummary ====================================
================================================================
bigWigSummary - Extract summary information from a bigWig file.
usage:
bigWigSummary file.bigWig chrom start end dataPoints
Get summary data from bigWig for indicated region, broken into
dataPoints equal parts. (Use dataPoints=1 for simple summary.)
NOTE: start and end coordinates are in BED format (0-based)
options:
-type=X where X is one of:
mean - average value in region (default)
min - minimum value in region
max - maximum value in region
std - standard deviation in region
coverage - % of region that is covered
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
================================================================
======== bigWigToBedGraph ====================================
================================================================
bigWigToBedGraph - Convert from bigWig to bedGraph format.
usage:
bigWigToBedGraph in.bigWig out.bedGraph
options:
-chrom=chr1 - if set restrict output to given chromosome
-start=N - if set, restrict output to only that over start
-end=N - if set, restict output to only that under end
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
================================================================
======== bigWigToWig ====================================
================================================================
bigWigToWig - Convert bigWig to wig. This will keep more of the same structure of the
original wig than bigWigToBedGraph does, but still will break up large stepped sections
into smaller ones.
usage:
bigWigToWig in.bigWig out.wig
options:
-chrom=chr1 - if set restrict output to given chromosome
-start=N - if set, restrict output to only that over start
-end=N - if set, restict output to only that under end
-udcDir=/dir/to/cache - place to put cache for remote bigBed/bigWigs
================================================================
======== blastToPsl ====================================
================================================================
blastToPsl - Convert blast alignments to PSLs.
usage:
blastToPsl [options] blastOutput psl
Options:
-scores=file - Write score information to this file. Format is:
strands qName qStart qEnd tName tStart tEnd bitscore eVal
-verbose=n - n >= 3 prints each line of file after parsing.
n >= 4 dumps the result of each query
-eVal=n n is e-value threshold to filter results. Format can be either
an integer, double or 1e-10. Default is no filter.
-pslx - create PSLX output (includes sequences for blocks)
Output only results of last round from PSI BLAST
================================================================
======== blastXmlToPsl ====================================
================================================================
blastXmlToPsl - convert blast XML output to PSLs
usage:
blastXmlToPsl [options] blastXml psl
options:
-scores=file - Write score information to this file. Format is:
strands qName qStart qEnd tName tStart tEnd bitscore eVal qDef tDef
-verbose=n - n >= 3 prints each line of file after parsing.
n >= 4 dumps the result of each query
-eVal=n n is e-value threshold to filter results. Format can be either
an integer, double or 1e-10. Default is no filter.
-pslx - create PSLX output (includes sequences for blocks)
-convertToNucCoords - convert protein to nucleic alignments to nucleic
to nucleic coordinates
-qName=src - define element used to obtain the qName. The following
values are support:
o query-ID - use contents of the <Iteration_query-ID> element if it
exists, otherwise use <BlastOutput_query-ID>
o query-def0 - use the first white-space separated word of the
<Iteration_query-def> element if it exists, otherwise the first word
of <BlastOutput_query-def>.
Default is query-def0.
-tName=src - define element used to obtain the tName. The following
values are support:
o Hit_id - use contents of the <Hit-id> element.
o Hit_def0 - use the first white-space separated word of the
<Hit_def> element.
o Hit_accession - contents of the <Hit_accession> element.
Default is Hit-def0.
-forcePsiBlast - treat as output of PSI-BLAST. blast-2.2.16 and maybe
others indentify psiblast as blastp.
Output only results of last round from PSI BLAST
================================================================
======== blat ====================================
================================================================
blat - Standalone BLAT v. 36 fast sequence search command line tool
usage:
blat database query [-ooc=11.ooc] output.psl
where:
database and query are each either a .fa, .nib or .2bit file,
or a list of these files with one file name per line.
-ooc=11.ooc tells the program to load over-occurring 11-mers from
an external file. This will increase the speed
by a factor of 40 in many cases, but is not required.
output.psl is the name of the output file.
Subranges of .nib and .2bit files may be specified using the syntax:
/path/file.nib:seqid:start-end
or
/path/file.2bit:seqid:start-end
or
/path/file.nib:start-end
With the second form, a sequence id of file:start-end will be used.
options:
-t=type Database type. Type is one of:
dna - DNA sequence
prot - protein sequence
dnax - DNA sequence translated in six frames to protein
The default is dna.
-q=type Query type. Type is one of:
dna - DNA sequence
rna - RNA sequence
prot - protein sequence
dnax - DNA sequence translated in six frames to protein
rnax - DNA sequence translated in three frames to protein
The default is dna.
-prot Synonymous with -t=prot -q=prot.
-ooc=N.ooc Use overused tile file N.ooc. N should correspond to
the tileSize.
-tileSize=N Sets the size of match that triggers an alignment.
Usually between 8 and 12.
Default is 11 for DNA and 5 for protein.
-stepSize=N Spacing between tiles. Default is tileSize.
-oneOff=N If set to 1, this allows one mismatch in tile and still
triggers an alignment. Default is 0.
-minMatch=N Sets the number of tile matches. Usually set from 2 to 4.
Default is 2 for nucleotide, 1 for protein.
-minScore=N Sets minimum score. This is the matches minus the
mismatches minus some sort of gap penalty. Default is 30.
-minIdentity=N Sets minimum sequence identity (in percent). Default is
90 for nucleotide searches, 25 for protein or translated
protein searches.
-maxGap=N Sets the size of maximum gap between tiles in a clump. Usually
set from 0 to 3. Default is 2. Only relevent for minMatch > 1.
-noHead Suppresses .psl header (so it's just a tab-separated file).
-makeOoc=N.ooc Make overused tile file. Target needs to be complete genome.
-repMatch=N Sets the number of repetitions of a tile allowed before
it is marked as overused. Typically this is 256 for tileSize
12, 1024 for tile size 11, 4096 for tile size 10.
Default is 1024. Typically comes into play only with makeOoc.
Also affected by stepSize: when stepSize is halved, repMatch is
doubled to compensate.
-mask=type Mask out repeats. Alignments won't be started in masked region
but may extend through it in nucleotide searches. Masked areas
are ignored entirely in protein or translated searches. Types are:
lower - mask out lower-cased sequence
upper - mask out upper-cased sequence
out - mask according to database.out RepeatMasker .out file
file.out - mask database according to RepeatMasker file.out
-qMask=type Mask out repeats in query sequence. Similar to -mask above, but
for query rather than target sequence.
-repeats=type Type is same as mask types above. Repeat bases will not be
masked in any way, but matches in repeat areas will be reported
separately from matches in other areas in the psl output.
-minRepDivergence=NN Minimum percent divergence of repeats to allow
them to be unmasked. Default is 15. Only relevant for
masking using RepeatMasker .out files.
-dots=N Output dot every N sequences to show program's progress.
-trimT Trim leading poly-T.
-noTrimA Don't trim trailing poly-A.
-trimHardA Remove poly-A tail from qSize as well as alignments in
psl output.
-fastMap Run for fast DNA/DNA remapping - not allowing introns,
requiring high %ID. Query sizes must not exceed 5000.
-out=type Controls output file format. Type is one of:
psl - Default. Tab-separated format, no sequence
pslx - Tab-separated format with sequence
axt - blastz-associated axt format
maf - multiz-associated maf format
sim4 - similar to sim4 format
wublast - similar to wublast format
blast - similar to NCBI blast format
blast8- NCBI blast tabular format
blast9 - NCBI blast tabular format with comments
-fine For high-quality mRNAs, look harder for small initial and
terminal exons. Not recommended for ESTs.
-maxIntron=N Sets maximum intron size. Default is 750000.
-extendThroughN Allows extension of alignment through large blocks of Ns.
================================================================
======== calc ====================================
================================================================
calc - Little command line calculator
usage:
calc this + that * theOther / (a + b)
Options:
-h - output result as a human-readable integer numbers, with k/m/g/t suffix
================================================================
======== catDir ====================================
================================================================
catDir - concatenate files in directory to stdout.
For those times when too many files for cat to handle.
usage:
catDir dir(s)
options:
-r Recurse into subdirectories
-suffix=.suf This will restrict things to files ending in .suf
'-wild=*.???' This will match wildcards.
-nonz Prints file name of non-zero length files
================================================================
======== catUncomment ====================================
================================================================
catUncomment - Concatenate input removing lines that start with '#'
Output goes to stdout
usage:
catUncomment file(s)
================================================================
======== chainAntiRepeat ====================================
================================================================
chainAntiRepeat - Get rid of chains that are primarily the results of repeats and degenerate DNA
usage:
chainAntiRepeat tNibDir qNibDir inChain outChain
options:
-minScore=N - minimum score (after repeat stuff) to pass
-noCheckScore=N - score that will pass without checks (speed tweak)
================================================================
======== chainFilter ====================================
================================================================
chainFilter - Filter chain files. Output goes to standard out.
usage:
chainFilter file(s)
options:
-q=chr1,chr2 - restrict query side sequence to those named
-notQ=chr1,chr2 - restrict query side sequence to those not named
-t=chr1,chr2 - restrict target side sequence to those named
-notT=chr1,chr2 - restrict target side sequence to those not named
-id=N - only get one with ID number matching N
-minScore=N - restrict to those scoring at least N
-maxScore=N - restrict to those scoring less than N
-qStartMin=N - restrict to those with qStart at least N
-qStartMax=N - restrict to those with qStart less than N
-qEndMin=N - restrict to those with qEnd at least N
-qEndMax=N - restrict to those with qEnd less than N
-tStartMin=N - restrict to those with tStart at least N
-tStartMax=N - restrict to those with tStart less than N
-tEndMin=N - restrict to those with tEnd at least N
-tEndMax=N - restrict to those with tEnd less than N
-qOverlapStart=N - restrict to those where the query overlaps a region starting here
-qOverlapEnd=N - restrict to those where the query overlaps a region ending here
-tOverlapStart=N - restrict to those where the target overlaps a region starting here
-tOverlapEnd=N - restrict to those where the target overlaps a region ending here
-strand=? -restrict strand (to + or -)
-long -output in long format
-zeroGap -get rid of gaps of length zero
-minGapless=N - pass those with minimum gapless block of at least N
-qMinGap=N - pass those with minimum gap size of at least N
-tMinGap=N - pass those with minimum gap size of at least N
-qMaxGap=N - pass those with maximum gap size no larger than N
-tMaxGap=N - pass those with maximum gap size no larger than N
-qMinSize=N - minimum size of spanned query region
-qMaxSize=N - maximum size of spanned query region
-tMinSize=N - minimum size of spanned target region
-tMaxSize=N - maximum size of spanned target region
-noRandom - suppress chains involving '_random' chromosomes
-noHap - suppress chains involving '_hap|_alt' chromosomes
================================================================
======== chainMergeSort ====================================
================================================================
chainMergeSort - Combine sorted files into larger sorted file
usage:
chainMergeSort file(s)
Output goes to standard output
options:
-saveId - keep the existing chain ids.
-inputList=somefile - somefile contains list of input chain files.
-tempDir=somedir/ - somedir has space for temporary sorting data, default ./
================================================================
======== chainNet ====================================
================================================================
chainNet - Make alignment nets out of chains
usage:
chainNet in.chain target.sizes query.sizes target.net query.net
where:
in.chain is the chain file sorted by score
target.sizes contains the size of the target sequences
query.sizes contains the size of the query sequences
target.net is the output over the target genome
query.net is the output over the query genome
options:
-minSpace=N - minimum gap size to fill, default 25
-minFill=N - default half of minSpace
-minScore=N - minimum chain score to consider, default 2000.0
-verbose=N - Alter verbosity (default 1)
-inclHap - include query sequences name in the form *_hap*|*_alt*.
Normally these are excluded from nets as being haplotype
pseudochromosomes
================================================================
======== chainPreNet ====================================
================================================================
chainPreNet - Remove chains that don't have a chance of being netted
usage:
chainPreNet in.chain target.sizes query.sizes out.chain
options:
-dots=N - output a dot every so often
-pad=N - extra to pad around blocks to decrease trash
(default 1)
-inclHap - include query sequences name in the form *_hap*|*_alt*.
Normally these are excluded from nets as being haplotype
pseudochromosomes
================================================================
======== chainSort ====================================
================================================================
chainSort - Sort chains. By default sorts by score.
Note this loads all chains into memory, so it is not
suitable for large sets. Instead, run chainSort on
multiple small files, followed by chainMergeSort.
usage:
chainSort inFile outFile
Note that inFile and outFile can be the same
options:
-target sort on target start rather than score
-query sort on query start rather than score
-index=out.tab build simple two column index file
<out file position> <value>
where <value> is score, target, or query
depending on the sort.
================================================================
======== chainSplit ====================================
================================================================
chainSplit - Split chains up by target or query sequence
usage:
chainSplit outDir inChain(s)
options:
-q - Split on query (default is on target)
-lump=N Lump together so have only N split files.
================================================================
======== chainStitchId ====================================
================================================================
chainStitchId - Join chain fragments with the same chain ID into a single
chain per ID. Chain fragments must be from same original chain but
must not overlap. Chain fragment scores are summed.
usage:
chainStitchId in.chain out.chain
================================================================
======== chainSwap ====================================
================================================================
chainSwap - Swap target and query in chain
usage:
chainSwap in.chain out.chain
================================================================
======== chainToAxt ====================================
================================================================
chainToAxt - Convert from chain to axt file
usage:
chainToAxt in.chain tNibDirOr2bit qNibDirOr2bit out.axt
options:
-maxGap=maximum gap sized allowed without breaking, default 100