aserio changed the topic of #ste||ar to: STE||AR: Systems Technology, Emergent Parallelism, and Algorithm Research | stellar.cct.lsu.edu | HPX: A cure for performance impaired parallel applications | github.com/STEllAR-GROUP/hpx | Buildbot: http://rostam.cct.lsu.edu/ | Log: http://irclog.cct.lsu.edu/
EverYoung has joined #ste||ar
EverYoun_ has quit [Ping timeout: 240 seconds]
EverYoung has quit [Ping timeout: 265 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
hkaiser has quit [Quit: bye]
eschnett has quit [Quit: eschnett]
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoun_ has joined #ste||ar
EverYoung has quit [Read error: Connection reset by peer]
hkaiser has joined #ste||ar
daissgr has quit [Ping timeout: 256 seconds]
EverYoun_ has quit [Read error: Connection reset by peer]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 245 seconds]
EverYoung has joined #ste||ar
hkaiser has quit [Quit: bye]
EverYoung has quit [Ping timeout: 245 seconds]
K-ballo has quit [Quit: K-ballo]
Anushi1998 has quit [Quit: Leaving]
Vir has quit [Ping timeout: 265 seconds]
V|r has joined #ste||ar
hkaiser has joined #ste||ar
parsa has quit [Quit: Zzzzzzzzzzzz]
StefanLSU has joined #ste||ar
hkaiser has quit [Quit: bye]
parsa has joined #ste||ar
hkaiser has joined #ste||ar
nanashi55 has quit [Ping timeout: 265 seconds]
nanashi55 has joined #ste||ar
StefanLSU has quit [Quit: StefanLSU]
hkaiser has quit [Quit: bye]
CaptainRubik has joined #ste||ar
Anushi1998 has joined #ste||ar
parsa has quit [Quit: Zzzzzzzzzzzz]
Anushi1998 has quit [Remote host closed the connection]
hkaiser has joined #ste||ar
<hkaiser> heller_: yt?
<heller_> hkaiser: hey, good evening
jaafar has quit [Ping timeout: 264 seconds]
viraj has joined #ste||ar
viraj has quit [Ping timeout: 260 seconds]
mcopik has quit [Ping timeout: 260 seconds]
nikunj has joined #ste||ar
hkaiser has quit [Quit: bye]
Vir has joined #ste||ar
Vir has quit [Changing host]
Vir has joined #ste||ar
CaptainRubik_ has joined #ste||ar
CaptainRubik has quit [Ping timeout: 260 seconds]
CaptainRubik_ has quit [Ping timeout: 260 seconds]
<jbjnr> simbergm: you are correct - your fix didn't fix it :(
<jbjnr> (pycicle I mean)
hkaiser[m] has joined #ste||ar
<hkaiser[m]> heller_ yt??
<heller_> hkaiser[m]: hey
<heller_> hkaiser[m]: what's up?
<hkaiser[m]> hey, we need to talk later today
<heller_> sure, whenever you have time
<heller_> (even right now)
<hkaiser[m]> Will you be around?
<heller_> yes
<heller_> its 7pm at where you are at right now?
<hkaiser[m]> Ok, can't talk now
<heller_> sure
<hkaiser[m]> still in Tokyo
<heller_> I'll be here for at least another 5 hours
<hkaiser[m]> Ok, it's 7pm now
<hkaiser[m]> I'll ping you later
<heller_> ok
hkaiser[m] has quit [Read error: Connection refused]
<heller_> yay?
<zao> I need to figure out how to resize the HDD, not sure 100G is large enough to build HPX ;)
<heller_> :P
nikunj_ has joined #ste||ar
nikunj has quit [Ping timeout: 260 seconds]
CaptainRubik has joined #ste||ar
K-ballo has joined #ste||ar
<simbergm> jbjnr: I tried running it again now, result is correctly on dashboard, so maybe just wipe the build directories? :/
<simbergm> maybe it got confused by the old build directories
nikunj has joined #ste||ar
nikunj_ has quit [Ping timeout: 260 seconds]
nanashi64 has joined #ste||ar
nanashi55 has quit [Ping timeout: 256 seconds]
nanashi64 is now known as nanashi55
<CaptainRubik> jbjnr : Please check the comments on proposal.
hkaiser has joined #ste||ar
<hkaiser> heller_: now?
<heller_> hkaiser: yes
<hkaiser> skype?
<heller_> yes
mcopik has joined #ste||ar
<jbjnr> CaptainRubik: new ones, or the ones I made this morning?
daissgr has joined #ste||ar
<CaptainRubik> jbjnr: I replied. Should I send a mail with new findings?
<jbjnr> no need. I just wasn't sure if you had seen my comment from today
<jbjnr> I'll look now
<CaptainRubik> Thanks.
<CaptainRubik> Also, take a look at this. https://github.com/cksystemsgroup/scal The algorithms are same as libcds. However, the code seems much simpler at first look.
<jbjnr> good find. I don't have time to look deeply right now, ut I'll read your ;ates comments in case you've mentioned it
<CaptainRubik> I will add this there then. Thanks.
hkaiser_ has joined #ste||ar
hkaiser has quit [Ping timeout: 256 seconds]
<github> [hpx] msimberg created msimberg-patch-2 (+1 new commit): https://git.io/vAplb
<github> hpx/msimberg-patch-2 c957ec9 Mikael Simberg: Fix returns when setting config entries
<github> [hpx] msimberg opened pull request #3223: Fix returns when setting config entries (master...msimberg-patch-2) https://git.io/vAp8f
CaptainRubik has quit [Quit: Page closed]
daissgr has quit [Ping timeout: 256 seconds]
hkaiser has joined #ste||ar
hkaiser_ has quit [Ping timeout: 252 seconds]
daissgr has joined #ste||ar
nanashi55 has quit [Ping timeout: 260 seconds]
nanashi55 has joined #ste||ar
mcopik has quit [Ping timeout: 252 seconds]
hkaiser has quit [Quit: bye]
<zao> I can repro the hwloc-2 problem on my mac VM, yay.
diehlpk_mobile has joined #ste||ar
<Zwei> zao: congrats :D
<Zwei> lock-free an wait-free data structures is hard to do... I think I might just skip this chapter and come back to it.
<Zwei> Quickly finish this book, get started on working with HPX, then come back to it once I'm more familiar with concurrency.
daissgr has quit [Quit: WeeChat 1.4]
daissgr has joined #ste||ar
diehlpk_mobile has quit [Read error: Connection reset by peer]
diehlpk_mobile has joined #ste||ar
mcopik has joined #ste||ar
daissgr has quit [Client Quit]
daissgr has joined #ste||ar
daissgr has quit [Client Quit]
daissgr has joined #ste||ar
diehlpk_mobile2 has joined #ste||ar
parsa has joined #ste||ar
<zao> hwloc-info and hwloc-ls output is quite different between 1 and 2, yay.
diehlpk_mobile has quit [Ping timeout: 265 seconds]
diehlpk_mobile2 has quit [Read error: Connection reset by peer]
diehlpk_mobile has joined #ste||ar
diehlpk_mobile has quit [Client Quit]
daissgr has quit [Quit: WeeChat 1.4]
daissgr has joined #ste||ar
eschnett has joined #ste||ar
<zao> Good news, it occurs on Linux too.
<diehlpk_work> We have second interview about GSoC
<diehlpk_work> One of our students is interviewed about doing GSoC
<zao> Ah, interview in the heise sense.
<diehlpk_work> Yes
<diehlpk_work> mcopik, Will be interviewed about being a student and mentor
parsa has quit [Quit: Zzzzzzzzzzzz]
aserio has joined #ste||ar
<jbjnr> zao: we know that hwloc 2 breaks everything. I just realized that this issue was closed, and so was this https://github.com/STEllAR-GROUP/hpx/issues/3181 but we only fixed the compilation and not the execution, the second issue should not have been closed.
<jbjnr> I have reopened 3181
<jbjnr> #hashtag blame hkaiser
<zao> That's a tag I can get behind :)
RostamLog has joined #ste||ar
<Zwei> Also, if I want to do something similar for another peice of software (specifically, this: http://oomph-lib.maths.man.ac.uk/doc/html/index.html, my PhD project software), how do I go about getting started?
<simbergm> I don't know about configuring buildbot, but an alternative is pycicle + cdash
<simbergm> pycicle is a small python CI tool which submits results to a cdash server
<simbergm> assumes that you're using ctest though
<Zwei> thanks simbergm! :)
<simbergm> jbjnr is the guy who wrote pycicle btw
<jbjnr> s/guy/awesome dude/g
<Zwei> Thanks awesome dude :D
<simbergm> s/awesome dude/modest, awesome dude/g
<simbergm> ;)
<jbjnr> lol
<simbergm> but he's right
<jbjnr> sorry. I couldn't resist it.
<Zwei> We don't use CTest, so I might modify some stuff to make it work...
<jbjnr> bored waiting for my cholesky run to finally work after I broke everything again
<Zwei> We have our own self test scripts, it has error codes, so should be easy enough to gather which tests run/failed/etc...
eschnett has quit [Quit: eschnett]
jakub_golinowski has joined #ste||ar
aserio has quit [Ping timeout: 245 seconds]
<diehlpk_work> Hi jakub_golinowski any news about your proposal?
<jakub_golinowski> Hey
<jakub_golinowski> diehlpk_work I was travelling yesterday and had no chance to appear on the IRC but I have moved a bit forward and wrote down some questions
<jakub_golinowski> is it a good moment to ask you?
bibek has joined #ste||ar
<diehlpk_work> jakub_golinowski, yes
<jakub_golinowski> first question that I was thinking about for a while now is the issue of localities. For now I only have my laptop -> so this is a single machine. Is there a way in which HPX contributors develop code on single machine and simulate many localities? VMs, containers?
anushi has quit [Ping timeout: 245 seconds]
anushi has joined #ste||ar
aserio has joined #ste||ar
galabc has joined #ste||ar
<zao> A locality is in essence another process, so you can have multiple localities on the same machine.
EverYoung has joined #ste||ar
<zao> Some of the tests have multiple localities, for example.
<zao> They're interconnected with a parcelport, which we have a bunch of, most commonly the TCP and MPI ones.
<zao> jakub_golinowski: heller's answer to https://stackoverflow.com/questions/35367816/hpx-minimal-two-node-example-set-up may be a bit enlightening to how they're wired together.
<jakub_golinowski> zao: thank you very much!
<zao> Personally for my test runner, I run each run of the test suite inside a Singularity container, to completely network-isolate runs from each other.
EverYoung has quit [Read error: Connection reset by peer]
<zao> For production runs and test runs, you typically use the MPI parcelport and a batch system to run on a cluster.
<zao> (assuming you happen to have one around :D)
EverYoung has joined #ste||ar
<zao> There's a bit of a similarity to MPI tasks, where you can have multiple tasks per node depending on the kind of parallelism you're seeking.
<jakub_golinowski> could you point me to some resource where I can read more on the parcelport, I encouterd this term already a few times in the documentation but I still feel I am not fully aware what it is
<zao> I can't help you there, I've got no idea how they're used by the library.
* zao jiggles jbjnr a bit
<jakub_golinowski> ok, I will keep digging in this direction
<jakub_golinowski> but I think this will be my next step, the first step is to overcome my current initial difficulties with building appplication using HPX
mcopik has quit [Ping timeout: 248 seconds]
<jakub_golinowski> I walked through examples on from the documentation on how to build the hello_world example and hello_world_component example - this was successful
<zao> Squinting around, I guess they're responsible for the actual physical connection of localities, offering a rather low-level shoveling of message packets.
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
<jakub_golinowski> Next I wanted to develop my own application based on the partitioned_vector_spmd_foreach.cpp
<jakub_golinowski> Ok, thanks for the giving me the genaral idea on the parcelports
<zao> On top of that I assume we have serialization and telling remote runtimes to run things.
<zao> You have the "components" system which I think kind of looks like RPC stubs, where you've got an implementation and an interface, so you can invoke things on remote localities by signature.
<zao> Or something. Guessing wildly here :)
<zao> I could've sworn there were some talk about the internals of HPX.
<jakub_golinowski> bulding the .cpp file from examples was successful and then I wanted to reproduce the same process by just copying the file to another directory and trying to build it using pkg-config similarly to the example from library
<jakub_golinowski> Ok we are diverging in topics, I started talking about bulding appplication :)
<zao> Yeah, I was just flushing my buffer ;)
mcopik has joined #ste||ar
<jakub_golinowski> zao: you mean talks on IRC or talks on conferences?
<zao> Conferences.
<jakub_golinowski> that is greate, maybe there are some videos
<zao> But in general, ask silly questions when there's someone around that can answer them.
<jakub_golinowski> Yeah I feel that this question with building is a bit silly, but it is stopping me for now and I would like to crack this issue once and for all
<jakub_golinowski> Do you use cmake to build your applications using hpx?
<zao> So what's your problem there?
<zao> I've got to admit that I've never written novel code against HPX, only really building the tests/examples from the tree.
<zao> In essence you should just need to pull in the CMake module or invoke the right pkg-config files to get a suitable argument list.
<zao> Unless someone broke something.
<jakub_golinowski> so I want to write a simple code that will multiply two matrices in parallel for loop (HPX).
<jakub_golinowski> this was an initial task suggested by diehlpk_work which I think is very good because it touches some important parts of the actual project
jaafar has joined #ste||ar
<zao> Sure.
galabc has quit [Ping timeout: 240 seconds]
<jakub_golinowski> So first things first - I just want to play around with the example that already exists, change some code and get more familiarity with HPX
<diehlpk_work> jakub_golinowski, Once you are accepted for GSOC you will have access to a cluster
<jakub_golinowski> the example is as mentioned before partitioned_vector_spmd_foreach.cpp
<jakub_golinowski> diehlpk_work - that is good news :)
<jakub_golinowski> and now I went through the examples of building application that use HPX libraries
<diehlpk_work> There is a list of nodes of this cluster
<jakub_golinowski> thank you
<jakub_golinowski> So basically the command to build a simple (one-file) application is: export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:$HPX_LOCATION/lib/pkgconfig
<jakub_golinowski> c++ -o hello_world hello_world.cpp \
<jakub_golinowski> `pkg-config --cflags --libs hpx_application` \
<jakub_golinowski> -lhpx_iostreams -DHPX_APPLICATION_NAME=hello_world
<diehlpk_work> jakub_golinowski, I suggest to get opencv parallized with HPX on shared memory is sufficient for the gsoc project
<jakub_golinowski> diehlpk_work - ok I understand
<diehlpk_work> Opencv in parallel on shared memory with reading from a webcam and showing images from webcam in a qt application is enough
<diehlpk_work> This is quite challenging for the summer
<diehlpk_work> jakub_golinowski, You may want to use cmake to build your single file
<diehlpk_work> I think it would be a good example to understand how hpx is integrated in your own cmake project, because you have to do this for opencv too
<jakub_golinowski> Ok!
<diehlpk_work> https://stellar-group.github.io/hpx/docs/html/hpx.html#hpx.manual.build_system.using_hpx.using_hpx_cmake
<jakub_golinowski> Now I need to go for a workshop but I will be back in 4h - then I will start working on using cmake in case of difficulties I will ask here
<diehlpk_work> Sure, see you
<jakub_golinowski> Thank you very much for your time and I am sorry I need to go now
<diehlpk_work> No worries, enjoy your workshop
mcopik has quit [Ping timeout: 240 seconds]
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
jakub_golinowski has quit [Ping timeout: 260 seconds]
Smasher has joined #ste||ar
victor_ludorum has joined #ste||ar
galabc has joined #ste||ar
EverYoung has quit [Ping timeout: 252 seconds]
galabc has quit [Quit: Leaving]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 245 seconds]
EverYoung has joined #ste||ar
victor_ludorum_ has joined #ste||ar
victor_ludorum has quit [Ping timeout: 260 seconds]
mcopik has joined #ste||ar
aserio has quit [Ping timeout: 245 seconds]
galabc has joined #ste||ar
parsa has joined #ste||ar
galabc has quit [Remote host closed the connection]
galabc has joined #ste||ar
mcopik has quit [Ping timeout: 268 seconds]
aserio has joined #ste||ar
galabc has quit [Read error: Connection reset by peer]
<aserio> heller_: whaaattttt
<heller_> He
<aserio> did you talk to any of those guys?
<heller_> Pretty cool to read articles that use your software
<heller_> No
<aserio> wow
<aserio> :D
<zao> We should ask them how to use HPX ;)
<aserio> :p
<zao> « To obtain better sequential performance, and to have better opportunities to move to HPC platforms, we have extended the C++ parallel framework HPX to support HdpH-style distributed work stealing and re-implemented Maximum Clique on top. »
mcopik has joined #ste||ar
galabc has joined #ste||ar
nikunj has quit [Quit: Page closed]
mcopik has quit [Ping timeout: 260 seconds]
aserio has quit [Ping timeout: 245 seconds]
victor_ludorum_ has quit [Quit: Page closed]
parsa has quit [Quit: Zzzzzzzzzzzz]
parsa has joined #ste||ar
mcopik has joined #ste||ar
parsa has quit [Quit: Zzzzzzzzzzzz]
parsa has joined #ste||ar
nikunj has joined #ste||ar
aserio has joined #ste||ar
galabc has quit [Quit: Leaving]
<diehlpk_work> The more interesting thing is if the provide a pr with these features
hkaiser has joined #ste||ar
<hkaiser> aserio: hey
<aserio> hkaiser: hey
<hkaiser> see pm, pls
mcopik has quit [Ping timeout: 248 seconds]
nikunj has quit [Quit: Page closed]
mcopik has joined #ste||ar
eschnett has joined #ste||ar
hkaiser has quit [Ping timeout: 248 seconds]
jakub_golinowski has joined #ste||ar
eschnett has quit [Quit: eschnett]
bibek has quit [Quit: Leaving]
nikunj has joined #ste||ar
<github> [hpx] AntonBikineev created fix_3221 (+1 new commit): https://git.io/vAhKb
<github> hpx/fix_3221 c57900d AntonBikineev: Applying quick fix for hwloc-2.0
EverYoun_ has joined #ste||ar
<github> [hpx] AntonBikineev opened pull request #3225: Applying quick fix for hwloc-2.0 (master...fix_3221) https://git.io/vAh6v
hkaiser[m] has joined #ste||ar
<hkaiser[m]> aserio one more thing
<aserio> hkaiser[m]: yes
EverYoung has quit [Ping timeout: 252 seconds]
<hkaiser[m]> aserio could you ask Al to set up a builder using hwloc v2, pls
<hkaiser[m]> or change an existing one
<aserio> Can do, though I think he just left for the weekend
<hkaiser[m]> apparently v2 breaks our code
<hkaiser[m]> ok
hkaiser[m] has quit [Read error: Connection refused]
aserio has quit [Quit: aserio]
hkaiser has joined #ste||ar
<github> [hpx] AntonBikineev pushed 1 new commit to fix_3221: https://git.io/vAhPe
<github> hpx/fix_3221 6a5503f AntonBikineev: fixup! Applying quick fix for hwloc-2.0
nikunj has quit [Quit: Page closed]
EverYoun_ has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
<github> [hpx] AntonBikineev force-pushed fix_3221 from 6a5503f to d872312: https://git.io/vAhDP
<github> hpx/fix_3221 d872312 AntonBikineev: Applying quick fix for hwloc-2.0
hkaiser has quit [Quit: bye]
daissgr has quit [Ping timeout: 245 seconds]