aserio changed the topic of #ste||ar to: STE||AR: Systems Technology, Emergent Parallelism, and Algorithm Research | stellar.cct.lsu.edu | HPX: A cure for performance impaired parallel applications | github.com/STEllAR-GROUP/hpx | Buildbot: http://rostam.cct.lsu.edu/ | Log: http://irclog.cct.lsu.edu/
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 246 seconds]
EverYoung has joined #ste||ar
rod_t has left #ste||ar [#ste||ar]
vamatya has quit [Ping timeout: 240 seconds]
EverYoung has quit [Ping timeout: 240 seconds]
K-ballo has quit [Quit: K-ballo]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 240 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 246 seconds]
mcopik_ has quit [Ping timeout: 246 seconds]
parsa has joined #ste||ar
parsa has quit [Client Quit]
hkaiser has quit [Quit: bye]
parsa has joined #ste||ar
vamatya has joined #ste||ar
parsa has quit [Quit: Zzzzzzzzzzzz]
parsa has joined #ste||ar
parsa has quit [Client Quit]
vamatya has quit [Ping timeout: 240 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 246 seconds]
AnujSharma has joined #ste||ar
david_pfander has joined #ste||ar
EverYoung has joined #ste||ar
Matombo has joined #ste||ar
EverYoung has quit [Ping timeout: 246 seconds]
bikineev has joined #ste||ar
bikineev has quit [Remote host closed the connection]
bikineev has joined #ste||ar
bikineev has quit [Remote host closed the connection]
<github> [hpx] StellarBot pushed 1 new commit to gh-pages: https://git.io/v5jQg
<github> hpx/gh-pages 589dc2e StellarBot: Updating docs
Matombo has quit [Remote host closed the connection]
AnujSharma has quit [Remote host closed the connection]
Matombo has joined #ste||ar
Matombo has quit [Remote host closed the connection]
bikineev has joined #ste||ar
Matombo has joined #ste||ar
bikineev has quit [Ping timeout: 246 seconds]
K-ballo has joined #ste||ar
bikineev has joined #ste||ar
hkaiser has joined #ste||ar
<jbjnr> hkaiser: good day.
<hkaiser> hey jbjnr!
<hkaiser> good to see you!
<jbjnr> Is there a way to dump out a perf counter from code - so suppose I wanted to print idle rate and just make a call like print "counter name"
<hkaiser> sure
<jbjnr> I want to dump out some papi counters,
<jbjnr> at the start and end of certain functions
<hkaiser> this will add some overhead, though
<jbjnr> I know I can retrieve a counter - but I just wanted to write the minimum amount of code ...
<jbjnr> overhead, no worries.
<hkaiser> it's a one liner
<jbjnr> if you can remember which example to look at ...
<hkaiser> performance_counter counter("<name>"); cout << counter.get_value();
<hkaiser> just don't create the counter each time, just once
<jbjnr> wow. great. thanks
<jbjnr> ah
<hkaiser> so it's 'cout << c.get_counter<double>(hpx::launch::sync);'
<jbjnr> hkaiser: I sent heller this pic to use in his presentation. https://pasteboard.co/GLo6bbL.png
<hkaiser> jbjnr: very nice - you're getting there!
<jbjnr> thanks for counter stuff. I used them ages ago and wasn't sure if there was an even easier way of getting the numbers.
<jbjnr> yes, getting very close now with the matrix work. Soo we will be ahead I think,.
<hkaiser> sure
<jbjnr> ^soon
<hkaiser> :D
<hkaiser> you're da'man!
<jbjnr> for the papi counters, I can't just query any counter can I - it needs to be one that was initialized at start yes? (I believe papi onkly allows a limited number to be used at once)
<hkaiser> jbjnr: I thik you can use any counter supported by the hardware - there is just a limit on how many you can have active at a time
<hkaiser> he creation of the counter initializes everything
<jbjnr> so if I exceed the limit - then one just gets invalidated I guess? I would not want to use 15 simulataneously if only 12 are allowed and I wonder how I should police that
<hkaiser> not sure - you might not be able to create more
<hkaiser> this is limited by the hardware
<heller> use papi_avail
<heller> to check which are there
<heller> for the number of counters, you'd need to check the docs
<hkaiser> heller: when is your talk today
<heller> 2:20
<hkaiser> ok, I'll try to tune in
<heller> do you know the meeting numberß
<heller> ?
<hkaiser> it's on zoom
<heller> hkaiser: any feedback for the slides?
<heller> yes
<hkaiser> heller: looks good
<heller> great
<heller> can't wait for the questions
<hkaiser> yah, got those numbers, thanks
<hkaiser> heller: any contacts yesterday?
<hkaiser> did you go to the dinner?
<heller> just a little too many slides for 30 minutes :/
<heller> yes, I went to the dinner
<hkaiser> yah, I thought that as well - you can shorten the first half a bit
<heller> yes
<hkaiser> heller: the important thing to highlight in your talk is (if you asked me) that AMTs (sorry for the term) are a viable alternative to classic programming models
<heller> agreed
<heller> I think everyone got that by now
<hkaiser> HPX just happens to be th eonly one which is currentl available to demonstrate that
<heller> well, there is always the MPI + X model
<heller> with X being kokkos
<hkaiser> forces fork-join on you
<hkaiser> on all levels
<heller> which is way more popular in the DoE circles
EverYoung has joined #ste||ar
<heller> ok, good to know
<heller> they don't have futures?
<hkaiser> shrug - I didn't say you should highlight anything others might do ;)
<hkaiser> heller: not that I know of
<hkaiser> try combining async computing with mpi - doesn't work
<heller> yes
<heller> How does the term "A standard C++ AMT" sound to you?
<hkaiser> shrug - anything works if it works to get people understand what you want to say
<hkaiser> the term AMT is used in DoE circles, so you can't go wrong using it
EverYoung has quit [Ping timeout: 246 seconds]
<heller> ok
<jbjnr> heller: can we watch your talk online? I see dial in numbers, but not a linky link kind of link thingy
<heller> jbjnr: it's using zoom
<hkaiser> jaafar: it's zoom, so yes
<heller> where you can watch it
<hkaiser> jbjnr: ^^
<heller> zoom meeting id: Meeting ID: 468 190 374
<heller> works quite nicely on linux
<heller> I was asked to upload my PPT file, they looked quite confused when I told them I only got tex sources
<heller> I'm too stupid for powerpoint :/
<hkaiser> makes your 'hero-programmer' image just so much more believable ;)
<hkaiser> the trick with PPT is to use a MOUSE ;)
<jbjnr> I got silence with zoom
<hkaiser> too early
<jbjnr> ok
<hkaiser> it's 5:43 over there
<jbjnr> I go for tea now then
<hkaiser> AM
<jbjnr> no video either?
<heller> jbjnr: there will be video
<jbjnr> ok
<heller> hkaiser: I prefer the term coder ninja
<jbjnr> 5:43 - I see. I though 2pm or something
<hkaiser> tex junkie
<jbjnr> "sad loser"
<hkaiser> lol
parsa has joined #ste||ar
parsa has quit [Client Quit]
<heller> jbjnr: it is 5:45 now
<heller> jbjnr: the talk will be 14:20 california time
<github> [hpx] hkaiser closed pull request #2912: Update contributors (master...update_contributors) https://git.io/v5jJA
<heller> -9
<github> [hpx] hkaiser pushed 3 new commits to master: https://git.io/vdeYv
<github> hpx/master e1ae8c0 Taeguk Kwon: Add test_container for supporting proper container based on iterator tag in benchmark of parallel algorithms.
<github> hpx/master 3e81ff3 Taeguk Kwon: Use test_container for using proper container based on iterator tag in benchmarks of parallel algorithms.
<github> hpx/master 52c57eb Hartmut Kaiser: Merge pull request #2908 from taeguk/tg_benchmark_iter_tag...
<heller> sorry, +9 to get the right one
<hkaiser> heller: you merged a PR which makes inspect unhappy
<heller> the bind one?
<hkaiser> the numa_balanced
<hkaiser> John's PR
<heller> i trusted your "LGTM" :/
<hkaiser> shrug, that was before other things got merged
<heller> yes
<heller> boost::format being deprecated, ok
<hkaiser> heller: K-ballo created a wrapper function to hide it and to replace it in the future
<heller> ok, should be easy enough to fix
<hkaiser> right
<jbjnr> for the HPX course we have 9 students. Most of them are either CSCS or ETHZ people I already know :(
<jbjnr> one of them is my boss!
<jbjnr> it seems that now that HPX is a real thing and we can compete with parsec etc - things will take off :)
<heller> 9 students?
<heller> hmmm
<heller> we did have like 20 the last time, right?
<jbjnr> it's a shame, cos 8 is the cutroff to cancel it.
<jbjnr> and we have already decided that from now on, it will be bi-annual - every 2 years
<jbjnr> has wash changed jobs? seems to be nvidia affiliation in new contributors branch on PPR
<heller> yes, he did
bikineev has quit [Ping timeout: 264 seconds]
<zao> Aye.
<jbjnr> does that mean more hpx in nvidia, or less hpx for wash?
<zao> Same algos, different codebase IIUC.
<zao> (Thrust)
<heller> jbjnr: only the future can tell
<jbjnr> <groan>
<zao> We need more covert information channels.
<zao> Let the data flow!
<heller> what kind of AMR is octotiger again?
<jbjnr> regular grid patch based octtree?
<heller> sounds good
<heller> block structured, IIRC
<hkaiser> heller: yah, wash wants to rediscuss async algorithms ;)
<hkaiser> last time they went belly up in the committee because of nvidia
<heller> ;)
<heller> is there any information on raja available?
<hkaiser> I don't have anything
<heller> only see two year old tech reports
aserio has joined #ste||ar
<heller> and a github repo which is said to only contain core features which LLNL is willing to share
<hkaiser> forget it
<jbjnr> don't waste time on the opposition.
<hkaiser> jbjnr: I think wash at nvidia will help us, no matter whether he will do more or less HPX
<jbjnr> hope so
<hkaiser> heller: will you fix that inspect issue or should I do it?
<hkaiser> well, actually it's jbnr's fault anyways ;)
<jbjnr> ok. I fic it
<jbjnr> ^fix
<heller> do it!
<hkaiser> thanks
<heller> one thing bryce is good is networking, he will always be tied to HPX ;)
<hkaiser> nod
<heller> jbjnr: did you see the HPX twitter from one of the MS devs?
<hkaiser> which one?
<heller> that one
<hkaiser> yah, talked to him afterwards...
<heller> and what did he say?
<hkaiser> that in order to get the algorithms performant one would need something like hpx underneath
<heller> ;)
<jbjnr> hkaiser: I'd like to add scheduler_policies to async/task launch - so that we can guide the scheduler when we add tasks- similar to using high priority or low, but it needs to be more customizable for each different algorithm. (so cholesky might use one set of scheduler params, but QR decomposition another). have you thought about this at all. I don't really want to provide another async...
<jbjnr> ...overload, but I might need to.
<heller> -"something like"
<hkaiser> jbjnr: executors?
<jbjnr> with(scheduler_policy(...)) is what I'm thinking of now
<hkaiser> now would be a good time to get the executor story straight...
<jbjnr> so yes, executors, but new param types
<heller> btw, can someone have a look at #2891 please?
<jbjnr> this would go beyond the current standard
<hkaiser> jbjnr: sure, the parameters are beyond the standard anyways
<jbjnr> for the linear algebra we need a way of telling the scheduler about the tasks with extra hints etc.
<hkaiser> jbjnr: I have a half finished parameters revamp here on my disk, can't get it done...
<jbjnr> anything interesting that I might liketo experiment with - this is next on my todo list (urgetnt for cholesky), so I'm happy to help
<hkaiser> the whole thing is currently a big mess in hpx - some parts have been redone, some not
<jbjnr> indeed
<hkaiser> jbjnr: ok, let me raise the priority of the parameters refactoring
<hkaiser> will try to do it asap
<jbjnr> you can dump a half finished branch on me if you want.
<hkaiser> ok, will have a look
<jbjnr> but I'd naturally prefer you to finish what you're doing first :)
hkaiser has quit [Quit: bye]
parsa has joined #ste||ar
<github> [hpx] biddisco pushed 1 new commit to master: https://git.io/vde8s
<github> hpx/master fc4769a John Biddiscombe: replace boost::format with hpx::util::format
<jbjnr> <cough> pushed inspect fix to master <cough>
aserio has quit [Quit: aserio]
<heller> jbjnr: good luck!
<jbjnr> with?
aserio has joined #ste||ar
pagrubel has joined #ste||ar
<heller> jbjnr: not being yelled at by hartmut :P
pagrubel is now known as pat[[w]]
<pat[[w]]> aserio: I guess there's no meeting until next week?
eschnett has quit [Quit: eschnett]
StefanLSU has joined #ste||ar
pree has joined #ste||ar
vamatya has joined #ste||ar
EverYoung has joined #ste||ar
StefanLSU has quit [Quit: StefanLSU]
rod_t has joined #ste||ar
EverYoung has quit [Ping timeout: 252 seconds]
pat[[w]] has quit [Quit: Leaving]
mcopik has joined #ste||ar
hkaiser has joined #ste||ar
eschnett has joined #ste||ar
bikineev has joined #ste||ar
EverYoung has joined #ste||ar
EverYoun_ has joined #ste||ar
EverYoung has quit [Ping timeout: 248 seconds]
EverYoun_ has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
pree has quit [Read error: Connection reset by peer]
jaafar_ has joined #ste||ar
jaafar has quit [Ping timeout: 246 seconds]
pradeepisro49 has joined #ste||ar
pree has joined #ste||ar
pree has quit [Quit: AaBbCc]
david_pfander has quit [Ping timeout: 240 seconds]
harsh has joined #ste||ar
<harsh> Hey
<harsh> I want to know is Stellar is interested in Algorithmic Graph theory related projects?
<harsh> In parallel setting
<harsh> Like Modular decomposition in Parallel
<harsh> Anyone there?
<heller> hey harsh
<harsh> Hey
<harsh> Could you please see my query and response
<heller> we welcome any project
<harsh> Even for GSoC-2018?
<heller> that is, we try to help all of our users
<heller> sure
<heller> that's still some time away ;)
<harsh> Ya I agree
<heller> you have to be a bit more specific on what you want to work on though
<heller> so what do you have in mind?
EverYoung has quit [Ping timeout: 246 seconds]
EverYoung has joined #ste||ar
<harsh> I will implement 3 algorithms in parallel, Modular Decomposition to get connected components from Graph G, Ear Decomposition and Getting Biconnected components from Graph G.
<heller> ok, what about graph data structures?
<harsh> It will be CSR
<harsh> Graph can be Directed and Undirected.
<heller> sure, do you have references for the parallel algorithms or will you try to develop them yourself from scratch?
<harsh> Mostly from scratch
parsa has quit [Quit: Zzzzzzzzzzzz]
<heller> ok, what's your background?
<harsh> I am an MS by Research student at IIIT-Hyderabad
<heller> ok, how would you rate your C++ knowledge (1 is worst, 5 is best)?
<harsh> My domain is Algorithmic Graph Theory in Parallel setting and recently I am published one paper(An Efficient Ear Decomposition Algorithm)
<heller> cool
<harsh> The complete experiments I have done in C++
<harsh> From past 3 years I am working in C++.
<harsh> Rating: 3.2 as it's been 10 months in Cuda
<harsh> I am not expert in C++ but above I am Avg
<harsh> Are you there?
<heller> you know, sometimes people are doing other stuff
<heller> just because I am not answering within a second, doesn't mean I disappeared
<harsh> Ya sorry for that
<heller> so trying to push for an answer is a little rude
<heller> anyways
<heller> I suggest for you to familiarize with HPX, try different things and see how it fits for your algorithms
<heller> and try to come up with a proposal as early as possible
<heller> so we can discuss various things
<harsh> Thanks for the suggestion, sure I will come up with an proposal.
<harsh> Where I need to share it if it's done?
<heller> depends on you ;)
EverYoun_ has joined #ste||ar
<harsh> is there any stellar Google group where we can discuss.
<harsh> ?
EverYoung has quit [Ping timeout: 246 seconds]
<heller> harsh: there is a mailing list, yes
<heller> harsh: hpx-users@stellar.cct.lsu.edu
<harsh> Thanks I will share the proposal soon
<harsh> Last question
<harsh> Is there any condition to contribute or solve some patch/issues?
<harsh> for submitting proposal?
aserio has quit [Ping timeout: 246 seconds]
bikineev has quit [Ping timeout: 240 seconds]
<heller> harsh: if we know you, it will be better. we don't have hard rules
<harsh> Thanks Heller for helping me.
<harsh> Have a good day
<harsh> Bye, I will try to complete the proposal as soon as possible and share it on the mailing list
<heller> you are welcome
<heller> try to familirize yourself with HPX first
Matombo has quit [Remote host closed the connection]
<harsh> Yes I will start from it first
StefanLSU has joined #ste||ar
twwright has quit [Quit: twwright]
EverYoun_ has quit [Remote host closed the connection]
parsa has joined #ste||ar
StefanLSU has quit [Quit: StefanLSU]
EverYoung has joined #ste||ar
StefanLSU has joined #ste||ar
mbremer has joined #ste||ar
StefanLSU has quit [Quit: StefanLSU]
twwright has joined #ste||ar
<heller> mbremer: hey
<heller> mbremer: I couldn't get the blas stuff to work ...
<mbremer> @heller: Hey how's stuff.
<heller> mbremer: but I pushed a branch which should help you: https://github.com/STEllAR-GROUP/hpx/tree/channel_direct
<heller> this should improve the performance of your code significantly
<mbremer> Cool! I will check it out and time it, and then get back to you.
<mbremer> Thanks for trying to build it. I know that's always a pain.
aserio has joined #ste||ar
<heller> got linker errors for some blas functions
<heller> no idea how to resolve that
<heller> tried to build lapack myself and failed :/
pradeepisro49 has quit [Quit: Connection closed for inactivity]
<mbremer> Linker errors for blas or the application?
<heller> the application
<heller> undefined reference to `dtrsm_'
<heller> and friends
<heller> essentially the same as reported here
aserio1 has joined #ste||ar
<mbremer> How strange. I'm definitely relying on the cmake FindXXXX's calls to do the heavy lifting there.
<heller> yeah
<heller> no idea what went wrong
aserio has quit [Ping timeout: 246 seconds]
aserio1 has quit [Client Quit]
aserio has joined #ste||ar
StefanLSU has joined #ste||ar
mbremer has quit [Ping timeout: 260 seconds]
parsa has quit [Quit: Zzzzzzzzzzzz]
hkaiser has quit [Quit: bye]
mcopik has quit [Ping timeout: 248 seconds]
harsh has quit [Remote host closed the connection]
Matombo has joined #ste||ar
parsa has joined #ste||ar
parsa has quit [Client Quit]
eschnett has quit [Quit: eschnett]
EverYoun_ has joined #ste||ar
EverYoung has quit [Ping timeout: 255 seconds]
aserio has quit [Ping timeout: 260 seconds]
aserio has joined #ste||ar
wash has quit [Quit: leaving]
wash has joined #ste||ar
hkaiser has joined #ste||ar
<hkaiser> aserio: yt?
<aserio> hkaiser: yes
<hkaiser> aserio: did you find the zoom info for Thomas' talk?
<aserio> hkaiser: I havent look yet
<aserio> Bibek and I are working on the website
<aserio> thanks!
<hkaiser> ok, cool
<heller> a few more minutes
diehlpk has joined #ste||ar
<hkaiser> heller: Im in
<heller> so you are listening to the ECP talk?
<hkaiser> yah
<heller> ;)
<heller> the ceremony should start in 10 minutes, and my talk is supposed to happen 20 minutes after the hour
<hkaiser> nod
<heller> hkaiser: third mention
<hkaiser> \o/
twwright has quit [Quit: twwright]
StefanLSU has quit [Quit: StefanLSU]
StefanLSU has joined #ste||ar
twwright has joined #ste||ar
Matombo has quit [Remote host closed the connection]
rod_t has left #ste||ar [#ste||ar]
EverYoun_ has quit [Remote host closed the connection]
ABresting has quit [Ping timeout: 252 seconds]
EverYoung has joined #ste||ar
ABresting has joined #ste||ar
<heller> and over
<heller> let's see the reactions
aserio has quit [Quit: aserio]
StefanLSU has quit [Quit: StefanLSU]
<hkaiser> heller: congrats again!
diehlpk has quit [Ping timeout: 260 seconds]
diehlpk has joined #ste||ar
<heller> hkaiser: thanks
<heller> hkaiser: blog post incoming
<heller> once the nersc announcement is out
EverYoun_ has joined #ste||ar
EverYoung has quit [Ping timeout: 240 seconds]
EverYoun_ has quit [Ping timeout: 240 seconds]