aserio changed the topic of #ste||ar to: STE||AR: Systems Technology, Emergent Parallelism, and Algorithm Research | stellar.cct.lsu.edu | HPX: A cure for performance impaired parallel applications | github.com/STEllAR-GROUP/hpx | Buildbot: http://rostam.cct.lsu.edu/ | Log: http://irclog.cct.lsu.edu/
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
<wash[m]> hkaiser, patg, aserio: small issue found while proofreading
<hkaiser> k
hkaiser has quit [Read error: Connection reset by peer]
hkaiser has joined #ste||ar
<wash[m]> On page 4, we state that ChaNGa and SWIFT "have demonstrated scalability up to 500K cores with a parallel efficiency of 93.4% and 100K cores with a parallel efficiency of 60%"
<wash[m]> Im confused by that
<wash[m]> Ohhhh
<wash[m]> It says respectively afterwards, I understand now
hkaiser has quit [Quit: bye]
hkaiser has joined #ste||ar
<github> [hpx] hkaiser force-pushed gentryx-master from a2c6708 to 4d7a55f: https://git.io/v71ZM
<github> hpx/gentryx-master 4d7a55f Hartmut Kaiser: Touching up on configuration settings...
eschnett has joined #ste||ar
hkaiser has quit [Quit: bye]
vamatya has quit [Ping timeout: 240 seconds]
zbyerly_ has quit [Ping timeout: 255 seconds]
K-ballo has quit [Quit: K-ballo]
EverYoung has quit [Ping timeout: 240 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 248 seconds]
patg has joined #ste||ar
<patg> wash wash[m] yt?
patg has quit [Read error: Connection reset by peer]
patg has joined #ste||ar
patg is now known as Guest19663
vamatya has joined #ste||ar
Guest19663 has quit [Quit: See you later]
bikineev has joined #ste||ar
vamatya has quit [Ping timeout: 240 seconds]
taeguk has joined #ste||ar
david_pfander has joined #ste||ar
bikineev has quit [Remote host closed the connection]
Matombo has joined #ste||ar
pree has joined #ste||ar
Matombo has quit [Remote host closed the connection]
Matombo has joined #ste||ar
bikineev has joined #ste||ar
hkaiser has joined #ste||ar
<github> [hpx] StellarBot pushed 1 new commit to gh-pages: https://git.io/v7MDa
<github> hpx/gh-pages b827ea4 StellarBot: Updating docs
<github> [hpx] hkaiser closed pull request #2773: Add sync_images() method to spmd_block class (master...spmd_block_with_sync_images) https://git.io/v7J2K
Kiril_ has joined #ste||ar
<Kiril_> Hi guys. I am looking at the hpx/examples/allgather. Does anyone have any benchmark plots comparing the HPX vs MPI allgather as implemented there?
<hkaiser> Kiril_: allgather is obsolete, don't look at it, it's to be removed soon
<hkaiser> an we don't have any benchmarks like this
<hkaiser> the idea is to avoid allgathers not replace them
<Kiril_> okay -- but do you have cases you need to do e.g. a bcast in HPX, or you are saying -- don't think at all in message passing ?
<hkaiser> sure there are cases for broadcasts, but not in terms of message passing (i.e. everbody blocks while waiting), but in the sense of distributing data
<hkaiser> Kiril_: but yah, we're still missing some of the logocal collective operations in hpx
<Kiril_> so in allgather we have non-blocking point-to-point, sometimes followed by wait_all -- are you saying we have a similar scheme, but without the wait_all ?
<hkaiser> we have gather and broadcast, but no allgather
<hkaiser> the allgather example is a (failed) attempt at creating one using hpx
<Kiril_> can you point me to a bcast? I spent quite a while implementing my own bcast based on allgather
<hkaiser> but it's failed because the person who wrote the example tried to 100% reproduce the mpi semantics
<Kiril_> and I see two variants there -- one where everyone gets a data, and one where the root sets the data everywhere
<hkaiser> hpx/lcos/broadcast.hpp
<Kiril_> thanks -- I was looking at examples
<hkaiser> sec
<Kiril_> thanks -- that helps a lot
<hkaiser> Kiril_: not everything is shown in examples, but almost all is in tests ;)
<hkaiser> Kiril_: but we have a lot of work to do in the area of collectives, any suggestions are welcome
<Kiril_> well, i assume you guys do broadcasts in "round-robin" fashion?
bikineev has quit [Ping timeout: 255 seconds]
<hkaiser> Kiril_: the broadcast is done in a tree fashion
<Kiril_> oh, that's better than i expected -- i guess i should look into the code
bikineev has joined #ste||ar
bikineev has quit [Ping timeout: 276 seconds]
<github> [hpx] hkaiser force-pushed fixing_2800 from 3c63fe5 to 69fef1f: https://git.io/v7X70
<github> hpx/fixing_2800 69fef1f Hartmut Kaiser: Adding hpx::launch::lazy and support for async, dataflow, and future::then...
<github> [hpx] hkaiser pushed 1 new commit to fixing_2800: https://git.io/v7MAs
<github> hpx/fixing_2800 338459f Hartmut Kaiser: Renaming launch::lazy --> launch::select
bikineev has joined #ste||ar
bikineev_ has joined #ste||ar
bikineev has quit [Ping timeout: 260 seconds]
bikineev_ has quit [Read error: No route to host]
bikineev has joined #ste||ar
bikineev has quit [Ping timeout: 255 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
<github> [hpx] hkaiser pushed 1 new commit to master: https://git.io/v7DJj
<github> hpx/master 751cf59 Hartmut Kaiser: Merge pull request #2810 from STEllAR-GROUP/disable_deprecated...
aserio has joined #ste||ar
eschnett has quit [Quit: eschnett]
<github> [hpx] hkaiser force-pushed gentryx-master from 4d7a55f to 942cbe9: https://git.io/v71ZM
<github> hpx/gentryx-master 2c9d041 Hartmut Kaiser: Touching up on configuration settings...
<github> hpx/gentryx-master d9e764d Hartmut Kaiser: Merge branch 'master' into gentryx-master
<github> hpx/gentryx-master 942cbe9 Hartmut Kaiser: Reintegrate latest changes from gentryx/master
<github> [hpx] hkaiser deleted disable_deprecated at 973cfaa: https://git.io/v7DI3
pree has quit [Read error: Connection reset by peer]
eschnett has joined #ste||ar
<hkaiser> jbjnr, heller, david_pfander: will you join the call?
<jbjnr> ok
K-ballo has joined #ste||ar
<aserio> hkaiser: ask Dominic if he could point to resources
<aserio> hkaiser, jbjnr: ^^
<hkaiser> aserio: nod
patg[[w]] has joined #ste||ar
<patg[[w]]> hkaiser: I couldn't hear you and my mic didn't work
hkaiser has quit [Quit: bye]
parsa[w] has joined #ste||ar
bikineev has joined #ste||ar
aserio has quit [Ping timeout: 248 seconds]
bikineev has quit [Ping timeout: 255 seconds]
Kiril_ has quit [Quit: Page closed]
EverYoung has joined #ste||ar
hkaiser has joined #ste||ar
EverYoung has quit [Ping timeout: 240 seconds]
bikineev has joined #ste||ar
mcopik has joined #ste||ar
pree has joined #ste||ar
david_pfander has quit [Ping timeout: 240 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 246 seconds]
zbyerly_ has joined #ste||ar
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
denis_blank has joined #ste||ar
akheir has joined #ste||ar
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
bikineev has quit [Read error: No route to host]
bikineev has joined #ste||ar
zbyerly_ has quit [Ping timeout: 276 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
<taeguk> Can I be allowed to utilize(refer) other open source code pieces?
<taeguk> I want to know if there is copyright problem.
* K-ballo hears alarm sounds
<taeguk> I want to utilize the function '_Search_mid_point' in http://parallelstl.codeplex.com/SourceControl/latest#include/experimental/impl/merge.h .
<K-ballo> just write your own?
<taeguk> yes I refered that code piece and re-writed that code for HPX.
<taeguk> But, re-writed code is still very similar to that.
mcopik has quit [Ping timeout: 260 seconds]
<zao> That code in particular is scary, as it has no mentions of license.
<zao> Ah, License tab on the right, Apache.
<zao> Still, icky.
<hkaiser> taeguk: reimplement it yourself
<hkaiser> you can be inspired by their code, pls don't copy it, though
<taeguk> hkaiser: I reimplemented it myself. But reimplemented code is similar.
<taeguk> algorithm is simple. So, it's hard to avoid similar implementation.
<hkaiser> sure
<taeguk> This is my version (Not completely.)
<hkaiser> sure, go ahead wth that
aserio has joined #ste||ar
mcopik has joined #ste||ar
<github> [hpx] hkaiser pushed 1 new commit to resource_partitioner: https://git.io/v7Di9
<github> hpx/resource_partitioner a5296f2 Hartmut Kaiser: Refactoring resource partitioner code...
<hkaiser> jbjnr: this does the refactoring of the RP stuff as discussed ^^
<github> [hpx] hkaiser force-pushed resource_partitioner from a5296f2 to 03964cf: https://git.io/v7lfK
<github> hpx/resource_partitioner 03964cf Hartmut Kaiser: Refactoring resource partitioner code...
mcopik has quit [Ping timeout: 240 seconds]
zbyerly_ has joined #ste||ar
<jbjnr> K-ballo: thanks yes - circle ci works when I'm logged in.
<jbjnr> hkaiser: ta. I'll pull and redo my stuff
zbyerly_ has quit [Quit: Leaving]
<hkaiser> jbjnr: should be trivial to change
<hkaiser> let me know if you run into issues, pls
bikineev has quit [Ping timeout: 240 seconds]
patg[[w]] has quit [Quit: Leaving]
<hkaiser> jbjnr: also, the RP stuff makes HWLOC mandatory now
<github> [hpx] hkaiser pushed 2 new commits to resource_partitioner: https://git.io/v7DyK
<github> hpx/resource_partitioner d5753a3 Hartmut Kaiser: Merge branch 'master' into resource_partitioner
<github> hpx/resource_partitioner d56eeeb Hartmut Kaiser: Fix exported symbols in resource::partition
<jbjnr> hkaiser: hwloc mandatory - is that a problem?
<jbjnr> it'd be nice if we could use a cmake external to install it if it isn't on the system
<hkaiser> not for me, just saying - it was optional so far
<hkaiser> I think mac doesn't have it
<hkaiser> does it?
<jbjnr> I'm sure I used it on mac
<hkaiser> k
<zao> hwloc claims to have macOS support, but you may have to end up building it yourself.
<zao> (or use one of those god-awful brew/ports systems)
<hkaiser> iirc, mac does not support setting affinities, though
<zao> Considering that you have to obtain Boost already, it's probably not a problem.
<zao> Ah.
<hkaiser> but as long as hwloc handles that we're fine
bikineev has joined #ste||ar
<github> [hpx] hkaiser pushed 1 new commit to fixing_2800: https://git.io/v7DHx
<github> hpx/fixing_2800 d50348c Hartmut Kaiser: Fixing future::then
hkaiser has quit [Quit: bye]
<zbyerly> Does the communication with agas goes through mpi if hpx uses mpi as parcelport?
Matombo has quit [Quit: Leaving]
taeguk has quit [Ping timeout: 260 seconds]
<heller> zbyerly: yes, why is that important?
hkaiser has joined #ste||ar
hkaiser has quit [Client Quit]
hkaiser has joined #ste||ar
mbremer_ has joined #ste||ar
<mbremer_> Hi, does anyone know if std::vector<datapar> will get serialized by HPX, where datapar is one of the vector types from the Vc library?
pree has quit [Quit: AaBbCc]
pree has joined #ste||ar
<hkaiser> mbremer_: should work, you need the corresponding headers, though
<mbremer_> @hkaiser: Thanks, so then presumably I need to pass the serialized version to the channel?
<hkaiser> no
<hkaiser> channel<vector<datapar>> should just work
<mbremer_> How convenient :)
mbremer_ has quit [Quit: Page closed]
bikineev has quit [Remote host closed the connection]
aserio has quit [Ping timeout: 276 seconds]
bikineev has joined #ste||ar
<K-ballo> hkaiser: there?
<hkaiser> K-ballo: here
eschnett has quit [Quit: eschnett]
<K-ballo> hkaiser: see pm
aserio has joined #ste||ar
<zbyerly> error: ‘unwrapped’ is not a member of ‘hpx::util’
<hkaiser> zbyerly: has been renamed
<hkaiser> what do you use it for?
<zbyerly> ok i will change LibGeoDecomp
<zbyerly> it's in the HPX send & recv
<hkaiser> either unwrap() or unwrapping(), depending on use case
aserio has quit [Client Quit]
<hkaiser> I thought however that we left it on for backwards compatibility
<hkaiser> denis_blank ^^
<zbyerly> hkaiser, it looks like the dataflow simulator isn't using it
aserio has joined #ste||ar
<denis_blank> hkaiser, zbyerly: Mh, the backwards compatibility should work, zbyerly did you rerun cmake?
<denis_blank> It's also possible that unwrapped was only included through another header implicitly, in that case the include was changed and it would cause a build error.
<zbyerly> denis_blank, sorry, hpx is a couple of days old
<zbyerly> denis_blank, it does suggest "unwrapping" as an alternative
<denis_blank> zbyerly: I assume that you mean the three occurences of unwrapped in https://github.com/STEllAR-GROUP/libgeodecomp/search?utf8=%E2%9C%93&q=unwrapped&type= in that case 2 of the 3 files are missing the "hpx/util/unwrapped.hpp" include.
<zbyerly> denis_blank, okay cool i will add those and check the bw compatibility
<zbyerly> denis_blank, we don't use that code anyway
<denis_blank> zbyerly: Ok, thanks. However I suggest you to upgrade the usage of unwrapped to unwrapping and unwrap respectively since unwrapped was deprecated: hpx::util::unwrapped(futures) -> hpx::util::unwrap(futures), hpx::util::unwrapped(idsFuture) -> hpx::util::unwrap(idsFuture), hpx::util::unwrapped(std::move(updateGroupCreationFutures)) -> hpx::util::unwrap(std::move(updateGroupCreationFutures))
akheir has quit [Remote host closed the connection]
<aserio> Does anyone use the .clang-format?
mcopik has joined #ste||ar
<hkaiser> ye
<hkaiser> s
<zao> yup
<zao> Not sure if I've configured my Vim to honor it up in the path, remangled a fair bit of my source as I patched stuff.
<zao> I should probably configure mine to just format my changes.
<aserio> zao: I am getting a weird error
<aserio> which means I am doing it wrong
<zao> We use reasonably new features in clang-format.
<zao> So you may need a fresher build of it if you're using distro packages.
<aserio> Error reading /home/aserio/sandbox/1d_test/.clang-format: Invalid argument
<aserio> Can't find usable .clang-format, using LLVM style
<aserio> zao: so ^^ might be do to the new features?
<zao> [03:52:12] <zao> The change of that key from a boolean to an enum was in like May, so you may need a newer clang-format binary.
<zao> Something about aligning of escaped newlines.
<zao> Or you might just have to configure your integration to look recursively up the directory tree, depending on the kind of fault you see.
<zao> The above is just what came to mind.
<aserio> sigh, thanks
<zao> Heh, there's guidelines in our .clang-format to not reformat-on-save and other intrusive things :)
<zao> I probably should've read that some time.
<hkaiser> lol
<aserio> yea, I was looking at that
pree has quit [Ping timeout: 258 seconds]
<github> [hpx] hkaiser force-pushed fixing_2800 from d50348c to 3a5ceae: https://git.io/v7X70
<github> hpx/fixing_2800 3a5ceae Hartmut Kaiser: Fixing future::then
aserio has quit [Quit: aserio]
pree has joined #ste||ar
jbjnr has quit [Remote host closed the connection]
pree has quit [Ping timeout: 258 seconds]
denis_blank has quit [Quit: denis_blank]
mcopik has quit [Ping timeout: 240 seconds]
<github> [hpx] hkaiser force-pushed resource_partitioner from d56eeeb to 9b97602: https://git.io/v7lfK
<github> hpx/resource_partitioner 9b97602 Hartmut Kaiser: Fix exported symbols in resource::partition
pree has joined #ste||ar
mcopik has joined #ste||ar
bikineev has quit [Ping timeout: 248 seconds]
pree has quit [Quit: AaBbCc]