aserio changed the topic of #ste||ar to: STE||AR: Systems Technology, Emergent Parallelism, and Algorithm Research | stellar.cct.lsu.edu | HPX: A cure for performance impaired parallel applications | github.com/STEllAR-GROUP/hpx | Buildbot: http://rostam.cct.lsu.edu/ | Log: http://irclog.cct.lsu.edu/
kisaacs has joined #ste||ar
EverYoung has quit [Ping timeout: 245 seconds]
Anushi1998 has quit [Quit: Leaving]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
katywilliams has joined #ste||ar
kisaacs has quit [Ping timeout: 260 seconds]
katywilliams has quit [Ping timeout: 240 seconds]
EverYoun_ has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
EverYoun_ has quit [Read error: Connection reset by peer]
EverYoung has joined #ste||ar
kisaacs has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
eschnett has joined #ste||ar
daissgr has quit [Ping timeout: 268 seconds]
prashantjha has joined #ste||ar
hkaiser has quit [Quit: bye]
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 260 seconds]
eschnett has quit [Quit: eschnett]
K-ballo has quit [Quit: K-ballo]
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 240 seconds]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 264 seconds]
sharonhsl has joined #ste||ar
katywilliams has joined #ste||ar
EverYoung has joined #ste||ar
katywilliams has quit [Ping timeout: 240 seconds]
EverYoung has quit [Ping timeout: 276 seconds]
kisaacs has quit [Ping timeout: 260 seconds]
katywilliams has joined #ste||ar
hkaiser has joined #ste||ar
katywilliams has quit [Ping timeout: 264 seconds]
mcopik_ has quit [Ping timeout: 248 seconds]
kisaacs has joined #ste||ar
sharonhsl has left #ste||ar [#ste||ar]
Anushi1998 has joined #ste||ar
nanashi55 has quit [Ping timeout: 260 seconds]
nanashi55 has joined #ste||ar
Anushi1998 has quit [Quit: Leaving]
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
hkaiser has quit [Quit: bye]
prashantjha has quit [Ping timeout: 245 seconds]
kisaacs has quit [Ping timeout: 264 seconds]
jaafar has quit [Ping timeout: 264 seconds]
anushi has quit [Ping timeout: 245 seconds]
anushi has joined #ste||ar
karan has joined #ste||ar
<karan>
Hello Everyone, My name is karan and i am a 3rd year graduate from ggsipu. I have a good experience with c++ and python with familiarity with numpy and pandas and deep learning techniques. I would like to contribute to Augment CSV file or other interesting projects. Would someone tell me about about the next steps please or help me connect with potential mentors.
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 240 seconds]
<jbjnr>
karan: "Augment CSV file" - I'm not familiar with that - is it one of our gsoc project ideas?
<jbjnr>
thanks. That's on of our older suggestions. Pat who suggested it, is no longer active in HPX, so I suspect it might be tricky to find a mentor. It overlaps with some work I want on trace view generation etc. simbergm is also mentioned as a mentor - he should be online soon, so let's see if he replies with anything useful ...
<jbjnr>
simbergm: btw - I upgraded the future_overhead test and tested my scheduler. it is 1.5x slower than the default one for empty tasks :(
<karan>
Yes, It's under Classic Project Ideas. Apart from that I had also found "Applying Machine Learning Techniques on HPX Parallel Algorithms" under Vanguard Projects Ideas very interesting.
<jbjnr>
karan: I think the machine learning project has had a lot of students enquiring. competition for that might be tough.
<karan>
I would like to have your suggestion too. I am very good in languages like C/C++ and Python. https://github.com/karanagg262, My github link to get a bit insight about me
CaptainRubik has joined #ste||ar
kisaacs has joined #ste||ar
kisaacs has quit [Ping timeout: 245 seconds]
prashantjha has joined #ste||ar
david_pfander has joined #ste||ar
<simbergm>
hi karan! that project *should* be fairly easy technically, so a large part of the project would be on exploring data/writing up examples... it's rather open ended, and you can change it to your liking
<simbergm>
I'm a new mentor so I don't know as much about that project as I should, but for me the most important parts are working csv destination and useful examples to help future users analyze their programs
<simbergm>
hkaiser is usually on later and he might be able to tell you exactly what doesn't work currently
katywilliams has joined #ste||ar
<simbergm>
but if you'd like to get started there's a comprehensive section on performance counters in the documentation
<simbergm>
building hpx and just playing around with the csv output, reading the source for those parts would also be good
<jbjnr>
isn't there another project dedicated to perf counters? couldn't the two be combined?
<simbergm>
yep, correct
<simbergm>
there's a project for a histogram counter, and one to add some more arithmetic or statistical counters
<simbergm>
these three can be moulded into something you like
<simbergm>
if you have a concrete use case for yourself it can make the goal of the project easier to define
<simbergm>
jbjnr: shame about the scheduler :/ I'm going to try what happens with a sliding semaphore or something like that
katywilliams has quit [Ping timeout: 260 seconds]
Viraj has joined #ste||ar
<jbjnr>
the histogram perf counters would be quite useful. For example, I would like to see distributions of packet sizes sent during messaging, but oit's not enough work fo 3 months
<jbjnr>
simbergm: I already upgraded the test to use slifding semaphore
<simbergm>
jbjnr: ok, any difference?
<simbergm>
it still waits for all futures at the end?
<simbergm>
jbjnr: have you tried running a warmup iteration of cholesky before the actual run? on my possibly broken std::allocator, single numa node test I get almost twice the flops on subsequent runs
Viraj has quit [Quit: Page closed]
<jbjnr>
simbergm: sorry. was on a call
<jbjnr>
semaphoe - yes, much faster - on laptop sub microsecond (if we believe it)
<jbjnr>
on daint it still crashes, even though I though I fixed it
CaptainRubik has quit [Quit: Page closed]
<jbjnr>
cholesky - I do N runs each tim and don;t see any real variation bigger than the nornal noise level
<simbergm>
but with the same runtime instance?
<jbjnr>
?
<jbjnr>
you mean restart the app>
<simbergm>
without stopping the runtime in between
<simbergm>
yeah
<simbergm>
do you run your binary N times or do you run the cholesky function N times?
<jbjnr>
ok. I run a new copy of the test each time, so the app restarts, but I do not believe this will change anything
<jbjnr>
we get 1TF
<jbjnr>
it's not going to double!
<simbergm>
no, this was with 128 blocksize
<jbjnr>
on daint?
<simbergm>
yeah
<jbjnr>
I don't believe you :)
<simbergm>
it might be bogus, but kind of makes sense if stacks etc get reused
<simbergm>
first time they have to be allocated fresh
<simbergm>
I don't believe it either, so take it with a grain of salt
<jbjnr>
aha. I see what you're getting at
<jbjnr>
yes. interesting
<jbjnr>
(clean up the stack reuse code btw)
<simbergm>
sure :)
<simbergm>
this is on master btw
<jbjnr>
ask heller_ what he broke - he said it wasn't as efficient as before
<simbergm>
heller_: what did you break?
<jbjnr>
I did not consider that. I will rerun with N iterations in single exe and see what happens
<simbergm>
(again?)
<simbergm>
...
<jbjnr>
so, with my semaphore based future test, the default scheduler gives 0.8 sec for 1million and my scheduler about 1.2 for 1 million
<jbjnr>
If we are losing 0.5 microseconds per task, then my scheduler is worth paying for, BUT
<simbergm>
how many threads?
<jbjnr>
if we are really losing 60microseconds on daint in a real app, then we have a problem
<simbergm>
yeah
<jbjnr>
on laptop, just a couple, can't run on daint yet due to crashy crash
Anushi1998 has quit [Read error: Connection reset by peer]
Dalvan has joined #ste||ar
<Dalvan>
Hi
<heller>
hi Dalvan
<heller>
you made it ;)
DalvanGriebler has joined #ste||ar
<DalvanGriebler>
I think now it works in my client
<Dalvan>
teste
Dalvan has quit [Quit: Page closed]
<DalvanGriebler>
das
<heller>
great
<heller>
Hi
<heller>
hi
K-ballo has joined #ste||ar
<zao>
heller: Building HPX with 2GB of RAM? :D
<heller>
zao: ever heard of cross compiling ;)?
<zao>
Fair enough.
EverYoung has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
katywilliams has joined #ste||ar
katywilliams has quit [Ping timeout: 264 seconds]
WCMATUZimsky has joined #ste||ar
WCMATUZimsky has quit [Client Quit]
Anushi1998 has joined #ste||ar
karan has quit [Quit: Page closed]
hkaiser has joined #ste||ar
eschnett has joined #ste||ar
victor_ludorum has quit [Ping timeout: 260 seconds]
Anushi1998 has quit [Ping timeout: 245 seconds]
ct-clmsn has joined #ste||ar
mcopik_ has joined #ste||ar
aserio has joined #ste||ar
hkaiser has quit [Quit: bye]
victor_ludorum has joined #ste||ar
diehlpk_work has joined #ste||ar
DalvanGriebler has quit [Ping timeout: 264 seconds]
DalvanGriebler has joined #ste||ar
<heller>
DalvanGriebler: diehlpk_work is your GSOC admin guy you need to talk to
katywilliams has joined #ste||ar
eschnett has quit [Quit: eschnett]
katywilliams has quit [Ping timeout: 265 seconds]
mbremer has quit [Quit: Page closed]
katywilliams has joined #ste||ar
nikunj_ has quit [Ping timeout: 260 seconds]
jakub_golinowski has joined #ste||ar
eschnett has joined #ste||ar
Anushi1998 has joined #ste||ar
anushi_ has joined #ste||ar
DalvanGriebler has quit [Quit: Ex-Chat]
akheir has joined #ste||ar
Anushi1998 has quit [Ping timeout: 240 seconds]
anushi_ is now known as Anushi1998
katywill1ams has joined #ste||ar
katywilliams has quit [Ping timeout: 260 seconds]
<simbergm>
jbjnr: still planning on splitting off the wait_or_add_new into a PR? I could start doing it now...
anushi_ has joined #ste||ar
Anushi1998 has quit [Ping timeout: 240 seconds]
anushi_ has quit [Client Quit]
Anushi1998 has joined #ste||ar
EverYoung has joined #ste||ar
zao- has joined #ste||ar
prashantjha has joined #ste||ar
EverYoung has quit [Remote host closed the connection]
victor_ludorum has quit [Ping timeout: 260 seconds]
EverYoung has joined #ste||ar
Smasher has joined #ste||ar
zao_ has quit [*.net *.split]
quaz0r has quit [*.net *.split]
prashantjha has quit [Ping timeout: 276 seconds]
quaz0r has joined #ste||ar
katywill1ams has quit [Ping timeout: 240 seconds]
katywilliams has joined #ste||ar
<Anushi1998>
heller: I am working towards "Implementation of Faster Associative Container for GIDs" for GSoC 2018
<Anushi1998>
So, I was looking this file hpx/src/runtime/agas/addressing_service.cpp
<Anushi1998>
I am thinking to implement Trie or some other data structure in separate file (to make implementation clean) and then we need to have storage of Vector of tuples.Is it correct?
<Anushi1998>
simbergm: Can I ask you a question regarding Issue #1668 Adapt all parallel algorithms to Ranges TS ?
EverYoun_ has joined #ste||ar
EverYoung has quit [Ping timeout: 276 seconds]
prashantjha has joined #ste||ar
EverYoun_ has quit [Remote host closed the connection]
EverYoung has joined #ste||ar
jaafar has joined #ste||ar
victor_ludorum has joined #ste||ar
<heller>
anushi:
<heller>
Anushi1998: Sounds good
<Anushi1998>
So shall I proceed with implementation of Trie?
hkaiser has joined #ste||ar
david_pfander has quit [Ping timeout: 260 seconds]
<Anushi1998>
hkaiser: I am trying to adapt adjacentfind.hpp to Ranges TS.I want to how should I decide to choose projection or not?....I am sorry if it sounds a silly question :(