Export and analyze your own data in Excel

17810121315

Replies

  • jeicorsair
    jeicorsair Posts: 7 Member
    Fantastic update!

    For some reason the Observed and Theoretical TDEE graph isn't generating for me (Excel 2013). The other 3 graphs (and rest of the document) work great. Not sure what might be causing that, but it's still worth using regardless.

    WN7EA9V.jpg
  • Snip8241
    Snip8241 Posts: 767 Member
    Bump....thanks!
  • missyjane824
    missyjane824 Posts: 1,199 Member
    Bump
  • freddi11e
    freddi11e Posts: 317 Member
    bump
  • heybales
    heybales Posts: 18,842 Member
    Couple of comments:

    - observed TDEE (oTDEE) doesn't use exercise or burn data; it's what you eat and gain/lose in weight that is used. It assumes a constant relationship of 3500 for each lb gained/lost (which isn't exactly true). Therefore the calculation isn't impacted at all by the fitbit adjustment or errors in evaluating or recording exercise burns.

    - by subtracting burns from oTDEE to create a "non-exercise" oTDEE we introduce those possible sources of error - fitbit corrections as exercise, burn data variability

    The resulting non-exercise oTDEE can be used to set-up MFP custom Net Calories Consumed* but what happens with those extra bitfit calories?

    Let's say that the fitbit is adding on 200 extra cals and exercises give 300 cals per day average. Let's build up an sample situation:

    Settings = 2000 cals
    oTDEE = 2500 cals
    burns=500 (200+ fitbit, 300 recorded)

    There wouldn't be an issue because the fitbit is only adding the extra cals missed from exercise and MFP setting. If the person recorded 400 exercise cals, the fitbit will only add 100 as it estimates the total burn and eliminates the exercise period - if the user wrote the correct duration when recording the exercise burn.)

    Does this make sense? Do you guys see it otherwise?

    That is totally correct, that adjustment, one direction or another, will happen if you have syncing pos/neg enabled.

    I wasn't even intending to attempt to bring Fitbit in to the equation, but merely that fact if you grab exercise records, and attempt to subtract them from oTDEE, some of those records are actually not exercise but adjustments to get MFP up to the TDEE Fitbit saw.

    Doesn't impact oTDEE at all.

    In fact, for using Fitbit, if someone is short and has a low BMR and low estimated TDEE outside of exercise (MPF maintenance) because of selecting sedentary, they get less deficit using MPF built-in methods than otherwise. Because MFP stops deficit at 1200.
    So if that meant you only got 330 deficit instead of selected 500, but you always were more active like Lightly Active, your max deficit would still only be 330 because of the way MFP handles the math.
    Better to select Lightly Active and get full 500 deficit, and receive a few more negative adjustments when the day is done.

    I wouldn't even try to include those points though.
    I was merely commenting on fact that everything that shows up as exercise isn't always exercise, but indeed has no effect on the oTDEE obtained by math.
  • JG762
    JG762 Posts: 571 Member
    Tag for later review.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    A big update on the data export tool is now available from the usual location - This is now Version 5.01

    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/new-mfp-data-export-tool-major-update-659927

    The tool remains fast - takes about 1-3 minutes to perform all downloads
    This is a major design overhaul - simplified to present all data in two tabs and now has help/explanation bubbles
    Single button execution and simple reset button
    Supports being printed out
    Works in mixed metrics/US/UK units, works in international Windows system parameters
    Resolved minor bugs on macro objective extractions and calculations
    It has all macro data including cholesterol, sodium, fiber and sugar on the start tab, along with the usual protein, carbs, fats pie charts for today, the last week and two weeks ago.
    Added an "ignore today" check box, now fully supported yet.
    Enjoy!

    y1I27VG.jpg
  • Aaron_K123
    Aaron_K123 Posts: 7,122 Member
    Very cool, playing with the latest update...looking good. I think my numbers are skewed a bit from eating more calories to recoup from a backpacking trip. If I let it default to a 14 day average on the TDEE calculation it says my TDEE is like 3600 which I think is an overestimate. Not the fault of the calculator though, just my behavior lately with regards to my diet and exercise has been erratic. Looks really good though, easy to use. Here are my results.

    TDEE_calc.jpg

    One thing I will say is that the trend-line it draws on the TDEE graph seems wrong.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Thanks for the feedback, Aaron!
    Looks like you are being quite successful.

    You are right the lower the number of days to average, it will have be influence by recent changes to diet/exercise. I should make sure to keep it at 30 days as default.
    The trend line drawn on the lower right graph is a linear least square fit - not "wrong", just not a good fit. You've either gotten more active as you lose, or worked on changing body comp. Food for thought for me - there's no reason that should be a linear trend, it's not a population analysis. We modify our behavior - will need to think about that line. Thanks.
  • ROBINSTL67
    ROBINSTL67 Posts: 50 Member
    Fantastic update!

    For some reason the Observed and Theoretical TDEE graph isn't generating for me (Excel 2013). The other 3 graphs (and rest of the document) work great. Not sure what might be causing that, but it's still worth using regardless.

    WN7EA9V.jpg

    I'm seeing this as well. Any suggestions?
    And thank you so much, this tool is amazing!!
  • Aaron_K123
    Aaron_K123 Posts: 7,122 Member
    Thanks for the feedback, Aaron!
    Looks like you are being quite successful.

    You are right the lower the number of days to average, it will have be influence by recent changes to diet/exercise. I should make sure to keep it at 30 days as default.
    The trend line drawn on the lower right graph is a linear least square fit - not "wrong", just not a good fit. You've either gotten more active as you lose, or worked on changing body comp. Food for thought for me - there's no reason that should be a linear trend, it's not a population analysis. We modify our behavior - will need to think about that line. Thanks.

    Fair enough on the trend fit, it just looked like it was weighting the earlier data heavier to me since it seemed a better fit would have been a straight flat line but math is math so I assume that is the best fit and its my eyes that deceive.
  • FletcherLoder
    FletcherLoder Posts: 21 Member
    I'm having an issue where my gross calories and macro data are lagging a couple days behind. Weight is showing on the correct day, but nothing else. For example, today 8/1/14 is showing my calorie and macro data from 7/29/14.

    Any idea what would cause this?
  • Jennifer_Lynn_1982
    Jennifer_Lynn_1982 Posts: 567 Member
    bump...want to look at this later at home...
  • Mikkimeow
    Mikkimeow Posts: 1,282 Member
    Umm, heck yeah
  • slk_5555
    slk_5555 Posts: 177 Member
    Bump........looks great. Thanks:flowerforyou:
  • jennetsullivan
    jennetsullivan Posts: 37 Member
    A big update on the data export tool is now available from the usual location - This is now Version 5.01

    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/new-mfp-data-export-tool-major-update-659927

    The tool remains fast - takes about 1-3 minutes to perform all downloads
    This is a major design overhaul - simplified to present all data in two tabs and now has help/explanation bubbles
    Single button execution and simple reset button
    Supports being printed out
    Works in mixed metrics/US/UK units, works in international Windows system parameters
    Resolved minor bugs on macro objective extractions and calculations
    It has all macro data including cholesterol, sodium, fiber and sugar on the start tab, along with the usual protein, carbs, fats pie charts for today, the last week and two weeks ago.
    Added an "ignore today" check box, now fully supported yet.
    Enjoy!

    y1I27VG.jpg

    Love the update - you are a game changer! Thank you!! :bigsmile:
  • tsawrie
    tsawrie Posts: 34 Member
    I don't think mine is working correctly. On my "check-in" tab, it doesn't list any calories, carb, fat, etc imported. But it shows net cals, cals burned. Nothing listed in the calculated from setup columns either. What am I doing wrong?
  • tsawrie
    tsawrie Posts: 34 Member
    Bump
  • HealthyBodySickMind
    HealthyBodySickMind Posts: 1,207 Member
    I can't believe I'm just now seeing this. I've been putting my mfp data into excel by hand for years!
  • nicsflyingcircus
    nicsflyingcircus Posts: 2,899 Member
    I have Excel 2003. Doubt this would work for me, which is unfortunate because it looks awesome!
  • 1Cor1510
    1Cor1510 Posts: 413 Member
    Bump
  • tracymayo1
    tracymayo1 Posts: 445 Member
    I get a cannot run Macro error when I hit "go" on the first page.. and nothing happens...
  • kimnsc
    kimnsc Posts: 560 Member
    I will check this out as soon as I get home from work. Thank you :flowerforyou:
  • wolfie640
    wolfie640 Posts: 49 Member
    Looks interesting , thanks!
  • Paulsz28
    Paulsz28 Posts: 4 Member
    Is there a way to make it capture ALL of my data going back to when I first joined MFP on 1/3/2011? Right now, I can set it to capture 1000 days max (without errors - entering a number higher than this throws errors), but then on the weight sheet it only goes back 500 days, and actually data starting on 8/6/2013 is all zeroes.

    My diary is set to public.

    Thanks, love the tool!
  • BFA1
    BFA1 Posts: 23 Member
    Is there troubleshooting that I can do if the numbers don't match? On the check-in tab, your workbook says I took in 1442 calories today -- but I haven't entered any data for today, yet! And it says 1858 for yesterday, but MFP says 1356.
  • meridianova
    meridianova Posts: 438 Member
    this tool really is amazing. i'm planning to take the results to my next doctor's appointment as proof that something really is wrong with me. according to my charts, my activity level is registering as below sedentary and i go to the gym 3-5 days a week.
  • Cladf
    Cladf Posts: 60 Member
    Doing a wee bump for myself for later so I can download this Excel wizardry when I get home - looks AMAZING!
  • tsawrie wrote: »
    I don't think mine is working correctly. On my "check-in" tab, it doesn't list any calories, carb, fat, etc imported. But it shows net cals, cals burned. Nothing listed in the calculated from setup columns either. What am I doing wrong?

    I am getting the same result. Any update available? Thanks for your work!
  • cindyj7
    cindyj7 Posts: 339 Member
    Thank you so much!