Export and analyze your own data in Excel

1910111315

Replies

  • Thepapu
    Thepapu Posts: 2 Member
    edited February 2015
    Great Tool , but it seems to only import my net calories , none of my macros. I completed my logging for each day , but still my macros don't import. Except for today's data.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Export Tool update - version 5.06: http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-data-export-tool-the-overview-659927

    corrections include
    - removed bug on reading dairy where no exercise data is present after a certain date
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Now that the program is a lot more stable - I'll do a few posts on how to read it and use the info you are getting. There is a lot there.

    #1 What to look for on the extractor and trend watcher

    The majors on tracking

    We want to track calories and macros. Are you tracking well?

    Look at the Report Card on the start tab. How is the logging section? If you aren't logging, significantly going over or under your objectives then you aren't using MFP effectively.

    bvoalx2o1rjr.jpg
    (1) Gives you a score based on how well you can track and log your info or meet your goals
    (2) Explains the issue

    How are your calorie goals and macros?

    Look at Calories Tracked, how are you doing on the weekly averages and 30 days. You should be hitting your cals here (or you might also have a tracking issue).

    Again on the report card, how are you meeting your macros? Look at Macro Tracking. See if you are getting the fat and protein you need. If not look at the uneaten macros, how much protein, fat are you leaving on the table?

    l84q7se5jthg.jpg
    (1) Gives you the goals you set up
    (2) How are you hitting those over the last 30 days. If you had hit your goals, you would have left 0 protein and 0 fat on the table. It's fine to leave some, but if you are consistently leaving a lot either you need to focus more on these macros or consider that your goals are not set correctly.
    (3) Gives you the 90 day average.
    Lets say you are still leaving 88g average over the last. That's a lot! But perhaps the trend (4) is in the right direction? Keep at it.

    Lets look at the macros in another way. Look at the remaining protein, for logged days graph.

    12cwxs1rgq4d.jpg

    See that line (1)? If you are improving, and meeting your protein goals it should be pointing towards zero or close to it. Here, in this case, there is room for improvement.
    You can also review the remaining fat graph in the same way (not shown).
  • yirara
    yirara Posts: 9,986 Member
    bumping
  • ephphy
    ephphy Posts: 20 Member
    Export Tool update - version 5.06

    How weird. Since this update I'm having trouble with the dates I wasn't before - having to do the recommended "International settings in Windows for date and numbers need to be set to US" (which has been there for ages yet I never had to do so!)

    Just a weird observation :)
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Export Tool update - version 5.07: http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-data-export-tool-the-overview-659927

    corrections include
    - removed issue with international date
    - cleaned graph formatting


  • ephphy
    ephphy Posts: 20 Member
    Dropbox link still goes to a 5.06 file - is that correct?
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    ephphy wrote: »
    Dropbox link still goes to a 5.06 file - is that correct?

    Should be fixed now - apparently the blog wasn't saving the change.
  • squirrelzzrule22
    squirrelzzrule22 Posts: 640 Member
    ephphy wrote: »
    Dropbox link still goes to a 5.06 file - is that correct?

    Should be fixed now - apparently the blog wasn't saving the change.

    getting an "invalid procedure call" notification when it fails. Any thoughts on what I'm doing wrong?

    This is beyond cool, btw. thank you so so much.
  • squirrelzzrule22
    squirrelzzrule22 Posts: 640 Member
    ephphy wrote: »
    Dropbox link still goes to a 5.06 file - is that correct?

    Should be fixed now - apparently the blog wasn't saving the change.

    getting an "invalid procedure call" notification when it fails. Any thoughts on what I'm doing wrong?

    This is beyond cool, btw. thank you so so much.

    nevermind, I think I clicked okay before logging in. trying again now.
  • oncem0re
    oncem0re Posts: 213 Member
    wow I wish I can still get this file - would love to use it! anyone that has the file that can share?
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    oncem0re wrote: »
    wow I wish I can still get this file - would love to use it! anyone that has the file that can share?

    The link is right there, three-four posts up.
  • shellma00
    shellma00 Posts: 1,684 Member
    Thanks.. this worked on my first try. Now if I can understand it all..
  • ephphy
    ephphy Posts: 20 Member
    shellma00 wrote: »
    Thanks.. this worked on my first try. Now if I can understand it all..
    This. I mean, I understand it all, mostly. But I'd like to see the next installment of the how to read and interpret like was done above with the macro tracking. I had SEEN those things before and been all "woe, I'll never reach 0 protein left" because my protein goals are usually quite high and I just don't have the appetite to eat that much (and will only force feed myself if I'm under 1200 cals). But since that post I've noticed that I actually have a :) sitting there and the arrow is heading at a downward angle, and so now instead of trying to hit that massive protein goal, I'm aiming to leave just a little less than my 30 day average. Eventually I'll be able to stomach the eating requires for a 0 left!
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Good point, I'll do that next.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    New blog on using the weight and observed TDEE trends:

    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-trend-watcher-what-to-look-for-2-731118

    Blog on the majors of tracking and macro trends
    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-trend-watcher-what-to-look-for-1-728404

    The updated extraction tool is here
    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-data-export-tool-the-overview-659927

    I just updated to a new version 5.08 - I've moved and cleaned the macro tracking info to a new tab and added per week loss so that it is easier to compare what was going on 6, 2, 1 months ago with last week.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Posting this for a discussion

    4qkw257eitzt.jpg

    weekly tracking of macros, weight and calories
  • beertrollruss
    beertrollruss Posts: 276 Member
    Looking forward to downloading the latest version when I get home tonight. Awesome work!
  • clcoble
    clcoble Posts: 9 Member
    For some reason I'm not getting any data in the graph for "Observed and Theoretical TDEE". Any ideas how to fix this? I saw a few others post this error awhile back.

    Thanks!
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    New version

    The updated extraction tool is here
    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-data-export-tool-the-overview-659927

    I just updated to a new version 5.09 - added a log out button on the first tab, resolved the latest TDEE graph issue.



  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    Update version

    The updated extraction tool is here
    http://www.myfitnesspal.com/blog/EvgeniZyntx/view/mfp-data-export-tool-the-overview-659927

    I just updated to a new version 5.10 - resolved issue on uploading configuration data from an update done by MFP.

  • discnjh
    discnjh Posts: 33 Member
    First of all, thanks so much for the tool and all the work you've put into it. For a data geek like me its quite nice to have. :)

    Couple things I've been having issues with.

    The first is around updating for changed calorie/macro goals. But given that MFP can't even seem to keep their stuff straight with their apps right now, I'm not surprised. My iPad app can't keep my adjusted calorie goal straight on the Home page, although it shows properly on the Diary page. So honestly not sure if there's even anything you can do about this issue, because the problem may be entirely theirs.

    What happens is when I select to update the user configuration, it imports a calorie goal of zero. I can work around this by just manually entering the calorie and macronutrient goals. Not a big deal.

    The second issue is around the spreadsheet itself. If I hit my at goals for 30 straight days, the spreadheet reports that I have missed it for all 30 days. In Cell Y8 on the checkin Tab, it reports 30 if the sum of all of Q4:Q34 is zero, which means that if none of those days had remaining fat, it reports that ALL of those days have remaining fat. Looks like the same thing would happen with protein.

    Oh, and the other thing I just remembered, although I think this is a function of changes in MFP as well, I'm now showing weight changes for every day in the past month, even though there were a handful of days I missed. Is MFP maybe now reporting interpolated data?
  • ephphy
    ephphy Posts: 20 Member
    An interesting observation which isn't necessarily a reflection on the tool more my strange body, but in the last month where I've gone from a very sedentary existence (think less than 3000 steps per day) to approx 3-5 hours of heart pumping exercise a week- my observed activity level reported on the third tab has fallen from 1.7 to 1.1! Go figure!
  • justinhallas
    justinhallas Posts: 1 Member
    ephphy, it could very well be that, since this is the beginning of your weight loss, you lost a lot of water weight initially which translated into the program thinking your metabolism was very high. After that initial loss the rate of weight loss declined to something more reasonable and as such it thinks your metabolism dropped. When I'm looking at those numbers I normally average over 20-30 days and then still just take them with a grain of salt. If what you're doing is working, keep doing what you're doing! :)
  • ruggedshutter
    ruggedshutter Posts: 389 Member
    My activity goes up and down quite a bit depending upon how much I lose. I watch my oTDEE and set the scale as high as they can go. This gives me the most accurate TDEE number based upon my calorie and exercise logging. I used to try and get my activity level as high as I could then I finally emailed EvgeniZyntx and asked him what was going on. His response was that it was probably due to losing a large amount in a short time. Since then I focused on TDEE.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    ephphy wrote: »
    An interesting observation which isn't necessarily a reflection on the tool more my strange body, but in the last month where I've gone from a very sedentary existence (think less than 3000 steps per day) to approx 3-5 hours of heart pumping exercise a week- my observed activity level reported on the third tab has fallen from 1.7 to 1.1! Go figure!
    My activity goes up and down quite a bit depending upon how much I lose. I watch my oTDEE and set the scale as high as they can go. This gives me the most accurate TDEE number based upon my calorie and exercise logging. I used to try and get my activity level as high as I could then I finally emailed EvgeniZyntx and asked him what was going on. His response was that it was probably due to losing a large amount in a short time. Since then I focused on TDEE.

    That's correct.

    Consider a large increase in activity. A hypothetical you suddenly 'burns' 3 extra hrs of exercise but given that you just started to exercise - you aren't seeing the equivalent weight loss in the first weeks. So - 'for the period' - the observed activity level will go down. It is from the observed energy balance.

    Don't sweat it. As your weight goes down or averaged over a larger period of time it will come back to a more realistic value.
  • EvgeniZyntx
    EvgeniZyntx Posts: 24,208 Member
    discnjh wrote: »
    First of all, thanks so much for the tool and all the work you've put into it. For a data geek like me its quite nice to have. :)

    Couple things I've been having issues with.

    The first is around updating for changed calorie/macro goals. But given that MFP can't even seem to keep their stuff straight with their apps right now, I'm not surprised. My iPad app can't keep my adjusted calorie goal straight on the Home page, although it shows properly on the Diary page. So honestly not sure if there's even anything you can do about this issue, because the problem may be entirely theirs.

    What happens is when I select to update the user configuration, it imports a calorie goal of zero. I can work around this by just manually entering the calorie and macronutrient goals. Not a big deal.

    The second issue is around the spreadsheet itself. If I hit my at goals for 30 straight days, the spreadheet reports that I have missed it for all 30 days. In Cell Y8 on the checkin Tab, it reports 30 if the sum of all of Q4:Q34 is zero, which means that if none of those days had remaining fat, it reports that ALL of those days have remaining fat. Looks like the same thing would happen with protein.

    Oh, and the other thing I just remembered, although I think this is a function of changes in MFP as well, I'm now showing weight changes for every day in the past month, even though there were a handful of days I missed. Is MFP maybe now reporting interpolated data?

    I'll check those issues out in the next week.
  • minties82
    minties82 Posts: 907 Member
    I adore this tool! It is absolutely amazing. Thank you so much.

    The Observed and Theoretical TDEE graph never works for me which is a bummer.
  • cfieser1
    cfieser1 Posts: 3 Member
    Is there a way to change the date max from 365 days to more?
  • bob98b3
    bob98b3 Posts: 1 Member
    Love this! One thing I would like to see is to have it import the "Check-In" data (beyond weight). I'm starting to track things to hopefully find a trend/correlation with what I eat and issues with my stomach. I'm going to be keeping track of how my stomach is every day on that Check In page so would be nice if things like that can get imported in as well. It could also be cool to have it import a description of what you ate for each day. Just a suggestion!