<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[gatk MarkDuplicatesSpark  内存溢出]]></title><description><![CDATA[<p dir="auto">gatk MarkDuplicatesSpark -I ${res}/${sample_id}_aligned_reads.sam<br />
-M ${res}/${sample_id}_dedup_metrics.txt -O ${res}/${sample_id}_sorted_dedup_reads.bam</p>
<p dir="auto"><a href="https://gatk.broadinstitute.org/hc/en-us/community/posts/360058452072-MarkDuplicatesSpark-consumes-enormous-amount-of-RAM" rel="nofollow ugc">https://gatk.broadinstitute.org/hc/en-us/community/posts/360058452072-MarkDuplicatesSpark-consumes-enormous-amount-of-RAM</a></p>
<pre><code>gatk MarkDuplicatesSpark \
            -I input.bam \
            -O marked_duplicates.bam \
            -M marked_dup_metrics.txt \
            --conf 'spark.executor.instances=10' \
            --conf 'spark.executor.cores=10' \
            --conf 'spark.executor.memory=8G'
</code></pre>
<p dir="auto">java.lang.OutOfMemoryError: GC overhead limit exceeded<br />
21/08/23 13:13:08 ERROR SparkContext: GC overhead limit exceeded<br />
java.lang.OutOfMemoryError: GC overhead limit exceeded<br />
Exception in thread "stop-spark-context" java.lang.OutOfMemoryError: GC overhead limit exceeded<br />
21/08/23 14:32:06 INFO SparkContext: SparkContext already stopped.<br />
14:32:06.038 INFO  MarkDuplicatesSpark - Shutting down engine<br />
[August 23, 2021 2:32:06 PM UTC] org.broadinstitute.hellbender.tools.spark.transforms.markduplicates.MarkDuplicatesSpark done. Elapsed time: 497.40 minutes.<br />
Runtime.totalMemory()=29172957184</p>
<hr />
<p dir="auto">A USER ERROR has occurred: Couldn't write file /data/result/X2_sorted_dedup_reads.bam because writing failed with exception java.lang.OutOfMemoryError: Java heap space</p>
<hr />
<p dir="auto">Set the system property GATK_STACKTRACE_ON_USER_EXCEPTION (--java-options '-DGATK_STACKTRACE_ON_USER_EXCEPTION=true') to print the stack trace.<br />
21/08/23 14:32:06 INFO ShutdownHookManager: Shutdown hook called<br />
21/08/23 14:32:06 INFO ShutdownHookManager: Deleting directory /tmp/spark-ee1e0044-6489-40a8-82c1-8474c9706ef1/userFiles-ac9b0eff-c752-4128-984a-76a953546dc4<br />
21/08/23 14:32:06 INFO ShutdownHookManager: Deleting directory /tmp/spark-ee1e0044-6489-40a8-82c1-8474c9706ef1</p>
]]></description><link>http://an.forum.genostack.com/topic/398/gatk-markduplicatesspark-内存溢出</link><generator>RSS for Node</generator><lastBuildDate>Sat, 13 Jun 2026 09:37:46 GMT</lastBuildDate><atom:link href="http://an.forum.genostack.com/topic/398.rss" rel="self" type="application/rss+xml"/><pubDate>Tue, 24 Aug 2021 02:18:35 GMT</pubDate><ttl>60</ttl></channel></rss>