aserio changed the topic of #ste||ar to: STE||AR: Systems Technology, Emergent Parallelism, and Algorithm Research | stellar.cct.lsu.edu | HPX: A cure for performance impaired parallel applications | github.com/STEllAR-GROUP/hpx | Buildbot: http://rostam.cct.lsu.edu/ | Log: http://irclog.cct.lsu.edu/
EverYoun_ has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoun_ has quit [Ping timeout: 240 seconds]
katywilliams has joined #ste||ar
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
EverYoung has joined #ste||ar
vamatya has quit [Ping timeout: 260 seconds]
gedaj has joined #ste||ar
vamatya has joined #ste||ar
EverYoung has quit [Ping timeout: 240 seconds]
EverYoung has joined #ste||ar
katywilliams has quit [Ping timeout: 264 seconds]
EverYoung has quit [Ping timeout: 260 seconds]
diehlpk has joined #ste||ar
katywilliams has joined #ste||ar
K-ballo has quit [Quit: K-ballo]
katywilliams has quit [Ping timeout: 260 seconds]
diehlpk has quit [Ping timeout: 240 seconds]
verganz has joined #ste||ar
katywilliams has joined #ste||ar
hkaiser has quit [Quit: bye]
katywilliams has quit [Ping timeout: 264 seconds]
nanashi64 has joined #ste||ar
nanashi55 has quit [Ping timeout: 276 seconds]
nanashi64 is now known as nanashi55
vamatya has quit [Ping timeout: 248 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
parsa has joined #ste||ar
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
katywilliams has joined #ste||ar
jaafar has quit [Ping timeout: 256 seconds]
diehlpk_work has quit [Remote host closed the connection]
diehlpk_work has joined #ste||ar
katywilliams has quit [Ping timeout: 256 seconds]
gedaj has quit [Remote host closed the connection]
gedaj has joined #ste||ar
simbergm has joined #ste||ar
parsa has quit [Quit: Zzzzzzzzzzzz]
david_pfander has joined #ste||ar
<github>
[hpx] msimberg closed pull request #3262: Making sure documentation correctly links to source files (master...fixing_3258) https://git.io/vxg8T
<zao>
simbergm: Regarding your release plan, I would love to contribute soak testing but for that to happen I need to actually write the software to drive it first :)
<zao>
I'm sure I've asked this before, but is there any way to redirect `build/Testing` somewhere else when running `ctest -T Test`, or in some way supply a TAG instead of the automatic date-based rollover thing?
<hkaiser>
zao: pycicle?
<hkaiser>
I mean, it's abunch of Python scripts, should be easy to add things...
EverYoung has quit [Ping timeout: 245 seconds]
<zao>
My problems are due to concurrently reusing the same build directory for multiple tests.
<zao>
pycicle IIRC just builds in a tree, tests, and sends it off to CDash.
<hkaiser>
nod
<zao>
Not quite sure that I could extend buildbot or pycicle in any meaningful way for this.
<hkaiser>
the naming scheme cmake uses is derived from the dir structure of the project itself
<zao>
And I still need to schedule individual tests.
<simbergm>
hmm, why do you run multiple tests concurrently in the first place? (genuinely curious, not complaining)
<simbergm>
(and great to hear that your interested)
<zao>
The purpose of my setup is to flush out flapping tests and rare failures.
<zao>
To do that, I run tests from the same build over and over again, either the whole test suite or individual tests.
<zao>
As I want a bit of concurrency, I want to run multiple instances of the same tests to get throughput up.
<simbergm>
right, it is possible to run multiple instances of pycicle with different directories, but it's not really convenient
anushi has joined #ste||ar
<simbergm>
running different tests concurrently should work well if each test gets its own pycicle configuration
<simbergm>
then the builds would go in a folder named after the configuration
<simbergm>
but to reuse build directories directly is a bit sketchy
<simbergm>
I'm not convinced pycicle would even be the right thing for this, you would probably be doing this for a curated set of tests that you know are failing sometimes?
<hkaiser>
simbergm: we should probably split the parallel tests for circleci
<zao>
Aye, the workflow is to checkout, build, extract the set of test names. Then based on *handwaving* a scheduler decides what test is most worth running next, and runs them until happy.
<hkaiser>
those dominate the whole setup
<zao>
My vision is that you'd have some baseline testing for all the tests, and have the ability as a user to tell the system to focus on some particular individual tests.
<zao>
Ooh, just figured out a way around the Testing/ directory. Symlink to a per-container /scratch filesystem.
<simbergm>
hkaiser: you're right, I'll do that
<simbergm>
zao: sounds pretty awesome :) but I'm not sure what the solution is
<hkaiser>
simbergm: thanks for your email wrt release plans
<zao>
Like the two I discovered during the release with an occurence rate of 1:1000+, for a new commit that you believe might address them you could tell the bot to drill deep on that particular test.
<hkaiser>
I agree to all accounts
<zao>
I've got the broad strokes mostly figured out, I just need to write the actual software to do it.
<simbergm>
would be really nice to be able to write github comments to restart tests/to run just some tests multiple times like you said
<zao>
The last week I've been wrangling the container software at work.
<simbergm>
"just" need to write the software
<simbergm>
:)
<simbergm>
hkaiser: happy to hear
<hkaiser>
simbergm: wrt sphinx docs
<hkaiser>
what format does it use for plain text? rst?
<simbergm>
yeah, rst
<simbergm>
I think markdown is an option but I would not use that
<hkaiser>
so we'd need to find a way to convert the qbk stuff
<simbergm>
mmh
<simbergm>
my searches turned out empty, but maybe there is something
<hkaiser>
at least halfway automatically
<simbergm>
otherwise some sed magic to do most of the hard work
<hkaiser>
uggh
<simbergm>
I think it would be a bit painful, which is why I put it there, but at least it's a one time thing
<hkaiser>
simbergm: it must have some way of consuming doxygen generated xml already
<simbergm>
sphinx? yes
<simbergm>
it's a sphinx extension called breathe that parses the xml and makes it available to sphinx
<hkaiser>
perhaps we can feed in our xml generated from qbk
<simbergm>
ooh, okay, maybe
<hkaiser>
I know the boost guys have created a docygen --> qbk converter, but that will not help us
<hkaiser>
otoh, qbk is almost markdown, shouldn't be too hard to convert
<hkaiser>
simbergm: there is another thing
<zao>
I was last working on digesting the Test.xml into something meaningful, when I accidentally broke my container system :D
<hkaiser>
boost is currently trying to relaunch their doc toolchain towards asciidoc
<hkaiser>
that will require some qbk conversion to markdown
<zao>
Speaking of Doxygen, I ran into this interpretation of Doxygen XML files recently - http://mcss.mosra.cz/doxygen/
<K-ballo>
really? peter is pushing for wide asciidoc adoption?
<simbergm>
zao, hkaiser: those are both already so much nicer than the standard boost docs
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 276 seconds]
mcopik has joined #ste||ar
aserio has joined #ste||ar
hkaiser has quit [Quit: bye]
<aserio>
simbergm: you are not afraid of prodding sleeping bears
<aserio>
:p\
EverYoung has joined #ste||ar
<github>
[hpx] msimberg opened pull request #3265: Split parallel tests on CircleCI (master...split-parallel-tests-circleci) https://git.io/vx27E
<simbergm>
aserio: you think so?
<simbergm>
they seem to be friendly bears at least...
<simbergm>
besides, spring is almost here ;)
<aserio>
Releases, buildbots, *and* documentation
jakub_golinowski has joined #ste||ar
<aserio>
you are brave sir
EverYoung has quit [Ping timeout: 245 seconds]
<simbergm>
well, maybe I just don't know what I'm getting myself into
<simbergm>
zao: btw, I think having soak testing for specific tests would be very nice, but would you *also* be willing to run a "normal pycicle instance? :)
<zao>
Maybe. Actually building the project is quite disruptive to the machine resource-wise, as it only has 16-32G of memory.
jakub_golinowski has quit [Ping timeout: 265 seconds]
hkaiser has joined #ste||ar
<simbergm>
zao: ok, that's fair
<zao>
Much like the discussion in the mail, I don't know what toolchains and options to target either.
<zao>
I currently just build with debian's clang-3.8 and system hwloc/gperftools and C++14 Boost 1.something.
hkaiser has quit [Quit: bye]
hkaiser has joined #ste||ar
<verganz>
prerequisites page is 404 now
<verganz>
Im sorry
<verganz>
its not
diehlpk has joined #ste||ar
hkaiser_ has joined #ste||ar
hkaiser has quit [Ping timeout: 276 seconds]
diehlpk has quit [Ping timeout: 240 seconds]
<github>
[hpx] hkaiser closed pull request #3251: Adds new feature: changing interval used in interval_timer (issue 3244) (master...issue-3244/interval_timer-update) https://git.io/vx85z
diehlpk has joined #ste||ar
vamatya has joined #ste||ar
aserio1 has joined #ste||ar
Smasher has joined #ste||ar
aserio1 has quit [Client Quit]
aserio has quit [Ping timeout: 240 seconds]
david_pfander has quit [Ping timeout: 268 seconds]
katywilliams has joined #ste||ar
gedaj_ is now known as gedaj
diehlpk has quit [Ping timeout: 256 seconds]
katywilliams has quit [Ping timeout: 240 seconds]
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 240 seconds]
jaafar has joined #ste||ar
jakub_golinowski has joined #ste||ar
EverYoung has joined #ste||ar
hkaiser_ has quit [Quit: bye]
katywilliams has joined #ste||ar
Anushi1998 has joined #ste||ar
akheir has joined #ste||ar
hkaiser has joined #ste||ar
gedaj has quit [Remote host closed the connection]
aserio has joined #ste||ar
jakub_golinowski has quit [Quit: Ex-Chat]
diehlpk has joined #ste||ar
diehlpk has quit [Ping timeout: 264 seconds]
diehlpk has joined #ste||ar
diehlpk has quit [Ping timeout: 264 seconds]
katywilliams has quit [Ping timeout: 276 seconds]
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 260 seconds]
EverYoun_ has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
<aserio>
hkaiser: yt?
<hkaiser>
here
<hkaiser>
aserio: ^^
Anushi1998 has quit [Quit: Leaving]
gedaj has joined #ste||ar
katywilliams has joined #ste||ar
vamatya has quit [Ping timeout: 268 seconds]
katywilliams has quit [Ping timeout: 268 seconds]
katywilliams has joined #ste||ar
akheir has quit [Remote host closed the connection]
aserio has quit [Ping timeout: 264 seconds]
katywilliams has quit [Ping timeout: 240 seconds]
aserio has joined #ste||ar
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 240 seconds]
aserio has quit [Quit: aserio]
Smasher has quit [Remote host closed the connection]
parsa[w] has quit [Read error: Connection reset by peer]