https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=1293 Summary: Swift log files too large Product: Swift Version: 0.94 Platform: PC OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: General AssignedTo: [email protected] ReportedBy: [email protected]

From a discussion on swift-devel a few months ago. There's currently no easy way to reduce very large Swift log files generated while running psim. For full scale runs, the logs were >200GB. I tried minimal and reduced logging, but it didn't make any noticeable difference. log4j can't be easily modified since Swift is coming from a module. We ended up disabling Swift logging altogether by using -logfile /dev/null. Unfortunately by doing this, we're unable to use the log plotters, which would be nice to have.

--- I'm running a script in 0.94.1 that generates a large log file. The script only runs 41 tasks and finishes in under 5 minutes, but the log file is 2.7 gigabytes. I have: provenance.log=false tracing.enabled=false I've tried "-minimal.logging" and "-reduced.logging" but it doesn't make much of a difference. What else can I do to reduce the log file size? I'm running Swift from a module so I can't easily edit any swift-wide log4j settings. The log is at http://web.ci.uchicago.edu/~davidk/logs/combine-20140403-2122-csdnssc1.log.g... (17mb compressed, 2.7 gigabytes uncompressed) Thanks, David --- -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.