Tuesday, 2011-11-08

*** raymonddull has quit IRC00:06
*** raymonddull has joined #xdandroid00:06
*** virsys has quit IRC00:09
*** virsys has joined #xdandroid00:13
*** bzo has quit IRC00:32
*** rpierce99 has quit IRC00:36
*** d3tul3 has quit IRC00:44
*** kalemas has joined #xdandroid02:03
*** corein has joined #xdandroid03:28
*** programmer8922 has joined #xdandroid04:49
*** hardwalker has quit IRC05:22
*** programmer8922 has quit IRC06:21
*** d3tul3 has joined #xdandroid06:55
*** raymonddull has quit IRC07:38
*** d3tul3 has quit IRC08:08
*** mgross029 has joined #xdandroid08:24
*** corein has quit IRC08:24
*** Kraln has quit IRC08:26
*** Kraln has joined #xdandroid08:36
*** dario_ has joined #xdandroid09:25
*** rpierce99 has joined #xdandroid09:34
*** helicopter88 has joined #xdandroid09:35
*** dario_ has quit IRC10:14
*** Tandyman100 has joined #xdandroid10:18
*** corein has joined #xdandroid10:34
*** vinceweis has joined #xdandroid11:25
*** raymonddull has joined #xdandroid11:40
*** ray|yar has joined #xdandroid12:01
*** raymonddull has quit IRC12:02
*** ray|yar is now known as raymonddull12:03
*** newbie has joined #xdandroid12:09
*** newbie is now known as Guest4269812:09
*** helicopter88 has quit IRC12:11
*** Guest42698 is now known as helicopter8812:23
*** programmer8922 has joined #xdandroid12:39
*** programmer8922 has quit IRC12:44
*** |Jeroen| has joined #xdandroid12:52
mgross029Quiet in here today13:19
* mgross029 looks around and listens to the crickets13:19
rpierce99solved all of the worlds problems yesterday13:19
mgross029ha13:19
mgross029gee I must have missed something in the logs. :p13:19
mgross029rpierce99, which rhod you on?13:20
rpierce99the best13:21
rpierce99the only one that matters13:21
* mgross029 wonders why he even bothered to ask. :p13:22
rpierce99oh you don't know which one that is?13:22
mgross029I'm guessing at rhod400, but wasn't sure13:22
rpierce99you can be sure, rhod400 is the best and the only one that matters13:23
mgross029Ummm  Ok...  If you say so.13:24
rpierce99my tongue-in-cheek self-centeredness is not coming through very well i think13:25
mgross029It sure is but my aloof reponses to your tongue-in-cheek self-centeredness must have been mistaken13:26
mgross029Anyway, so saw a lot of .39 commits yesterday wistilt2 was pretty busy.13:28
rpierce99i didn't look at them but i believe he was pulling in detules changes, so that they were both working from a shared base13:28
mgross029Ahh that's right remember reading that in the logs13:29
rpierce99he may have snuck in the change that allows non-rhodw to use it without losing the incall screen13:30
arrrghhhi'm sure he snuck that in13:30
arrrghhhconsidering it benefits him :P13:31
mgross029cool13:31
arrrghhhdamn you nmap13:31
mgross029He will have to change his git repo name. :p13:31
arrrghhh?13:31
mgross029linux-msm-rhod13:32
rpierce99it's still rhod, just not only 400/500 (W) now13:32
arrrghhhwent flying over my head13:32
arrrghhhyea... i don't get it13:32
arrrghhhstill RHOD...13:32
arrrghhhand his repo was always for all RHOD's... it's just the prox GPIO poop that needs tweaking for GSM folk13:32
mgross029Ahhh..  That flew over my head then...  Thought you were talking NON-Rhod period13:33
rpierce99no, snuck the w in on the end there13:33
rpierce99worldphones13:33
rpierce99the gsm only folk couldn't use prox13:33
arrrghhhyea those heathens don't test anything anymoar13:33
mgross029Interesting did not know that13:33
rpierce99no one did, until someone (wistilt2) tested it13:34
arrrghhhindeed13:35
arrrghhhemwe's GSM, but his RHOD is the good one.13:35
mgross029Someone with a working prox that is. :p13:35
arrrghhhhe's got a RHOD400 dude.13:35
arrrghhhso even if his prox did work...13:35
arrrghhhhe wouldn't have known the problem with GSM devices.13:35
mgross029Oh that's tru.  duh13:36
*** GlemSom has joined #xdandroid13:38
*** Tandyman100 has quit IRC13:43
*** Kraln- has joined #xdandroid13:44
*** rpierce99 has quit IRC13:45
*** Kraln has quit IRC13:45
*** Entropy512 has quit IRC13:45
*** rpierce99 has joined #xdandroid13:46
*** Entropy512 has joined #xdandroid13:46
rpierce99that was fun, i had my very own #xdandroid all to myself there for a bit13:47
arrrghhhlol13:47
arrrghhhwere you OP?13:47
rpierce99don't think so13:47
*** Entropy512 has joined #xdandroid13:47
*** AndersG has joined #xdandroid13:48
arrrghhhbummer13:48
rpierce99maybe if i had left and rejoined13:48
rpierce99thursday night football is back already? that sucks13:50
*** Tandyman100 has joined #xdandroid13:51
detulealright i am fairly certain that the OOM killer in .39 is not working as it should13:59
detuleor at all13:59
rpierce99the kernel oom killer? do we really want it to run?14:00
detulei thought android's runs on top of it14:00
rpierce99i have no idea how androids works, I've hypothesized that the kernel one is why we get reboots when downloading with the market though14:00
detuleneed emwe up in here so i can bisect him with questions14:01
rpierce99because we have memory overallocation enabled14:01
rpierce99yeah it looks like the android modification was to allow userspace to define the settings for the kernel oom handler14:04
*** helicopter88 is now known as helicAWAY14:25
detulefirst off, emwe's kernel has some sort of a swap of its own14:28
detulesecond, i am using some sort of a memory widget, and on .39 i can easily drop the available memory to under 20MB14:28
detuleat which point stuff starts breaking left and right14:28
detulethis just by openning maps, market, kindle app, browser14:28
detulemy launcher has an open tasks widget, so i can see they remain persistent in memory and are not closed14:29
detuleotoh, with .35 i can not drop available memory under 40MB14:29
rpierce99what is your lmk value?14:29
detulebrb14:29
*** |Jeroen| has quit IRC14:31
arrrghhhi'm betting the lmk stuff isn't working on .39 like he said.14:33
arrrghhhthe rootfs sets that value, and assuming he's comparing apples to apples...14:33
*** helicAWAY is now known as helicopter8814:46
detuleon .35 i notice items disappearing out of the task list also15:03
detuleas in the oom killer is actually working15:03
detuleon .39 not so much they stay there until i manually hit the big 'close all programs' button15:03
*** bzo has joined #xdandroid15:21
arrrghhhdetule, that's really odd15:22
arrrghhhbut i guess i don't really grasp what in the kernel those OOM/LMK values actually do15:22
detuleneither do i15:22
arrrghhhso perhaps .39 doesn't have the correct 'hooks' for userland to make any adjustments?15:22
arrrghhhlol15:23
arrrghhhguessing is fun :D15:23
bzothere is something really screwed in 39 as far as android accessing memory15:23
bzoright when I boot up, android thinks it only has about 50mb to use15:23
arrrghhhbzo!  what's up.15:23
arrrghhhlol15:23
bzohey arrrghhh15:24
bzoand after doing stuff the number keeps going lower until everything grinds to a halt15:24
arrrghhhhm15:24
bzoyou would expected used+available to stay the same15:24
bzobut that sum keeps going down15:24
arrrghhhodd..15:24
bzowhen I boot .35, android thinks it has about 130mb to use15:24
arrrghhhyou're not removing RAM physically from the phone are you bzo ?  :P15:25
bzoI think this is the heart of the slowdown problem in 3915:25
bzodetule - when you go to settings->apps->manage->running, what used+avail numbers do you see?15:26
detulebzo currently in a state of sod with .35 + usb15:27
detulei am going through the mm/Makefile15:27
detulewth is MEMBLOCK?15:27
arrrghhhheh15:27
detulebzo you are reading this about oom and .39 -> i can't get it to kill anything15:28
detuleif i let it, it will drop to <20mb available15:28
detule.35 and .39 boot with approx the same avail memory for me.....aprox 90mb15:28
bzodoesn't work regardless of v6 super script, right?15:29
detuleright same system same data as .35......in .35 i can't bring available memory below 40MB15:30
detuleit starts killing things off15:30
detulein .39 it doesn't seem to kill anything off the list15:30
bzoI think that may be a symptom of a bigger problem15:32
bzoI don't understand how used+free keeps going down, you would think it should be constant15:32
detuleandroid could be doing stuff in the background15:33
bzosure, but why would the total pool of memory shrink like that?15:34
bzomemory use seems fairly constant on the kernel side15:34
bzofree is showing 10-20mb available even when android is pegged15:34
bzopegged meaning something like 30mb used + 1mb free15:35
bzomaybe the memory free mechanism is not working between the kernel and dalvik, causing a huge memory leak15:36
detulehm what's in the kernel in terms of connecting with dalvik15:36
bzodunno, though the memory mechanism is probably not specific to android/dalvik15:37
*** infidelus has joined #xdandroid15:40
detulethis memblock is really suspicious15:51
bzodoesn't seem to be set in .3515:53
*** kalemas has left #xdandroid15:54
detuleor in .27 for that matter15:55
detuleeverything else is more or less the same except for this percpu_up vs percpu in comparison to .3515:55
detulealso in .39 we are not setting VMALLOC_RESERVE15:56
bzoI see some other android devices that have memblock enabled, so perhaps that is not a red flag16:00
bzodoes seem like vmalloc_reserve should be set though16:01
*** Tandyman100 has quit IRC16:02
detulei am just going to start listing things i think we should change16:03
detuleCONFIG_DEFAULT_MMAP_MIN_ADDR=3276816:03
detuleer scratch that cyano has it 32K, .35 is 32K, .39 and .27 at 4K16:06
*** raymonddull has quit IRC16:09
*** Tandyman100 has joined #xdandroid16:11
detulebzo, how come we are hardcoding this mem value CONFIG_CMDLINE="mem=64M console=ttyMSM,115200n8"16:12
arrrghhhmake it 1gb16:12
bzono clue...16:12
Tandyman100<Picard> Make is so.16:12
Tandyman100it*16:12
arrrghhh/fail16:12
Tandyman100That's just like me; try to make a bad joke, screw it up with a typo.16:12
arrrghhhlol16:13
bzoI do vaguely recall jonpry having problems with the 2nd memory bank16:13
bzohopefully he figured it out, and this is just a remnant of his testing16:13
detulei wonder if that default cmdline is needed for kexec16:17
*** GlemSom has quit IRC16:20
*** mgross029 has quit IRC16:30
*** AndersG has quit IRC16:32
*** helicopter88 has quit IRC17:01
*** programmer8922 has joined #xdandroid17:32
*** rpierce99 has quit IRC17:48
*** fishhead2567 has quit IRC17:58
*** ImCoKeMaN has quit IRC18:24
*** raymonddull has joined #xdandroid18:32
*** corein has quit IRC18:52
*** programmer8922 has quit IRC19:03
*** rpierce99 has joined #xdandroid19:14
*** d3tul3 has joined #xdandroid19:18
d3tul3ok looks like the oom_killer was in fact rewritten in .3919:24
d3tul3oom_adj is deprecated in favor for oom_score_adj19:24
rpierce99is there a simple place in userland to change that, or in the kernel to change it back?19:25
d3tul3they didn't leave us a way to simply revert back to oom_adj19:25
bzod3tul3: sounds like you may have found the problem19:28
bzocat oom_score_adj = -100019:28
bzoOOM_SCORE_ADJ_MIN19:28
d3tul3yeah something is not right with those values19:28
d3tul3ok so i need to understand this lowmemorykiller is sitting on top of oom_kill19:29
d3tul3lowmemorykiller has sysfs parameters adj and minfree19:30
d3tul3is adj relevant to the old oom_adj19:30
d3tul3or to the new oom_score_adj19:30
d3tul3either way actually it won't work19:30
d3tul3adj currently has values ranging 0 - 819:30
d3tul3if relevant to oom_score_adj it should have values -1000 to 1000 or something like that19:30
bzomaybe they are independent19:32
bzothe oom stuff may be handling stuff on the kernel side19:32
bzoand lmk is purely an android process killing mechanism19:33
bzowhen I echo 0 to oom_score_adj, linux free memory goes up to 30mb19:33
bzobut the android mem didn't seem to change19:33
d3tul3hm i thought lmk sits on top of oom19:33
d3tul3perhaps it only uses the oom score and kills independently19:34
d3tul3i think though the moral of the story is that in .39 i don't think oom_adj is actually updated19:34
d3tul3so if lmk looks at oom_adj to figure out what to kill19:34
bzowhere is the lmk source anyways? I'm not seeing it at the expected location of /drivers/misc19:35
d3tul3drivers staging android19:35
d3tul3"The lowmemorykiller driver lets user-space specify a set of memory thresholds19:35
d3tul3 * where processes with a range of oom_adj values will get killed."19:35
d3tul3ok since oom_kill was rewritten by google in .39 it seems, we just need to find an up to date lowmemorykiller19:36
bzoI seem to recall that jonpry started from the mainline 39 code19:37
bzoif so, it is entirely possible an old lmk was integrated19:37
d3tul3i can't find one based on oom_score_adj....19:42
d3tul3hm i guess we can just scale19:42
d3tul30-17 -> 0-100?19:42
bzolol, the fun of being on the bleeding edge19:43
bzoI'm not sure there are any other .39 android kernels, are there?19:43
d3tul3i haven't seen any19:43
*** larryone has quit IRC19:46
rpierce99https://lkml.org/lkml/2010/2/15/322 decent description of the difference between the two19:49
d3tul3dinnertime bbl19:49
*** larryone has joined #xdandroid19:59
rpierce99https://lkml.org/lkml/2010/2/15/315 says that oom_adj may still be used with the old range but it is then scaled to oom_score_adj units for a rough linear approximation.20:01
d3tul3only the write handle scales20:08
d3tul3the read handle (which probably lowmemorykiller) doesn't scale (i think)20:08
bzoI think the old stuff may be deprecated but functional20:08
bzocm has a .37 kernel that uses the same lmk driver20:09
bzonew oom stuff started in .3620:09
d3tul3look at oom_adjust_read and *_write here https://gitorious.org/~detule/linux-msm-rhod/detules-linux-msm-rhod/blobs/9c8f8e3867cca493dcb2887592b03d3c9a06979a/fs/proc/base.c20:09
d3tul3they even give us the scale formula, we just use that formula in the _read handle and we're in business20:10
d3tul3oh bzo, didn't realize that, perhaps this oom business is not it after all20:11
bzoyeah, I'm starting to think this is not it20:11
bzodid you try any of the kernel config changes yet?20:13
d3tul3which ones? memblock didn't help20:14
bzohow about the vmalloc setting?20:14
d3tul3on the to-do-list for later tonight bbl family time20:18
bzocan probably skip that, looks like the VMALLOC_RESERVE is not part of the 39 tree20:23
bzoand in the .35 tree, it is being set to the default of 128m anyways (which is what it is hardcoded to in .39)20:24
*** hardwalker has joined #xdandroid20:29
d3tul3there's no way lowmemorykiller is working as it should when every single process returns oom_adj -1620:42
d3tul3need to boot 35 to see what kind of values processes report there20:42
d3tul335 reports 4 for gapps, 10 for maps20:52
d3tul3(both -16 on .39)20:53
d3tul3echo "6" > debug_level in lowmemorykiller/parameters spits out all the lmk activity in dmesg (dmesg | grep adj)21:00
*** infidelus has quit IRC21:00
*** BulitPruf has joined #xdandroid21:38
*** BulitPruf has left #xdandroid21:49
*** [7] has quit IRC22:01
*** TheSeven has joined #xdandroid22:01
*** raymonddull has quit IRC22:02
*** programmer8922 has joined #xdandroid22:48
*** TheSeven has quit IRC22:59
*** [7] has joined #xdandroid22:59
*** programmer8922 has quit IRC23:45

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!