Export and analyze your own data in Excel

jenschroll · July 2014

This is awesome. Giving it a *bump* so others can see it, too. Thanks!

Moonbeamlissie · July 2014

bump

_Thriving_ · July 2014

bump

FJcntdwn2sknyluv · July 2014

:cheer: :flower: thanks!

ZBuffBod · July 2014

Bump

WolnaDusza · July 2014

Bumpitty....thank you OP!

JessByrdy · July 2014

Tag - to look at when I get home from work

Smirnoff65 · July 2014

Tagging for download when I get home from work :flowerforyou:

sjaplo · July 2014

Wonderful info - thanks for doing this! Its pretty awesome.

A question - I reset the number of days to import to 180 to reflect just this year and I get two errors on the report card. Calorie Objectives "#VALUE" and TDEE "#DIV/0". I'm assuming the latter is because I switched to TDEE minus 20% a month ago and stopped entering exercise? Any suggestions on the former?

Thanks in advance.

Edited to say;
Whoops! I hit import again with the number reset and that fixed it.

thanks.

LucasEVille · July 2014

Just tagging for later.

kbeloved · July 2014

bump for later

EvgeniZyntx · July 2014

Tool is updated -

It is now possible to use a slider to change the number of days used to calculate the observed TDEE average from 5 to 30 days. This allows one to visualize the influence of recent changes on TDEE (just slide it to 5) or to keep it at the lower noise values of 20, 25 or 30 days.

http://www.myfitnesspal.com/blog/EvgeniZyntx/view/new-mfp-data-export-tool-major-update-659927

V4.04 - TDEE vs Weight graph now varies for higher TDEE limits, average number of days for TDEE calculation can be set with slider
V4.05 - A date calculation issue with International date format was resolved

nutmegoreo · July 2014

Thank-you for this. :flowerforyou: :drinker:

:drinker: :flowerforyou:

EvgeniZyntx · July 2014

Welcome!

Latest update:

V4.07 - Calculates (Observed TDEE - Reported Exercise) in the graphs tab and corresponding chart is updated, "ignore today" function now works. Resolves location issue for foreign date settings in Windows, calculates targets for people trying to gain weight.

http://www.myfitnesspal.com/blog/EvgeniZyntx/view/new-mfp-data-export-tool-major-update-659927

EvgeniZyntx · July 2014

Question asked

I have a question about your export tool. I am wondering if the tool takes into account the type of workout, intensity of workout, or duration, or is it simply based on number of workouts logged? Or is this the reason for the different estimates for TDEE, to compensate for the different workout intensities?

That's a good question - I'll try to address that here but if it isn't clear please let me know.

It does use the workout/burn data but let me get to that.

Covering Total Daily Energy Expenditure(TDEE): For the calculation of observed TDEE or theoretical TDEE the tool does not need work out data. Let's look at these and see why.

First, what I call theoretical TDEE is just your TDEE from the standard equations - it is based on your activity level and this is why in the graph you see different curves for theoretical TDEE. Now observed TDEE is based on calculating your TDEE from the amount of food calories you consume and the average weight loss you get (and we assume that weight loss is 3500 cals per lb lost...). So neither of these use directly the workout/burn data. This calculation is consistent whether you enter every workout or not.

As of the latest version, I also report theoretical a new number [TDEE - exercise] - this takes the amount of calories burned reported from exercise, a fitbit, etc.. and subtracts them from the tTDEE. [TDEE-exercise] allows you to see what your daily need might be if you didn't have those reported calorie burns. In order to calculate that the program only looks at calories burned - there is no data on frequency, duration or intensity that is used. But, in general these factor affect the calorie burn - they are part of what makes the burn a burn.

How does this affect you and what can you do with the data?

If you find that the Activity Level result is relatively low (1.2-1.4 or less) it means that the estimated daily exercise level plus general activity *might* be low. (Under reporting calories eaten will also give you that.) If this is the case, consider upping your activity level during the day - this is lifestyle stuff not just more exercise sessions.

Your observed TDEE - if the diary data is accurate - tells you that this is your possible maintenance calorie level that you are experienced. Eating 5%-20% below that level results in the "reasonable" weight loss window.

The three top straight lines in the graph are just different activity level for theoretical TDEE (calculated from weight, gender, age and bf%), the fourth straight line is the theoretical Resting Daily Energy Expenditure (someone who is sedentary) vs your observed TDEE data, the dark orange line (from weight loss and diary calories reported) and with exercise subtracted, the light orange line.

Kotuliak · July 2014

Thanks!

TheWorstHorse · July 2014

bump

heybales · July 2014

Do you think it would be useful for the non-exercise TDEE that might help to decide to change your daily activity level (for those doing MFP method I'd gather) to use the MFP multipliers rather than the TDEE charts that include exercise?

It seems if you are going to take any TDEE and subtract the exercise back out, you are now getting a value that is really only going to be useful doing it MFP method, since you must be adding exercise back in.

Because their multiplier's are based on new study research and are different than the TDEE charts.

Sedentary - 1.25
Lightly Active - 1.4
Active - 1.6
Very Active - 1.8

EvgeniZyntx · July 2014

Do you think it would be useful for the non-exercise TDEE that might help to decide to change your daily activity level (for those doing MFP method I'd gather) to use the MFP multipliers rather than the TDEE charts that include exercise?

It seems if you are going to take any TDEE and subtract the exercise back out, you are now getting a value that is really only going to be useful doing it MFP method, since you must be adding exercise back in.

Because their multiplier's are based on new study research and are different than the TDEE charts.

Sedentary - 1.25
Lightly Active - 1.4
Active - 1.6
Very Active - 1.8

Ok, I can update those. And yes, I think that TDEE - ex it really is useful only for MFP settings (a pseudo RMR if you are really logging all exercise)

If I get this correctly, you are also suggesting giving a table with

(oTDEE - exercise) * activity factor = MFP non-exercise TDEE

I could also include an x cut for y lbs per week subtractor.

I'll see what I can build out without creating confusion.

heybales · July 2014

Do you think it would be useful for the non-exercise TDEE that might help to decide to change your daily activity level (for those doing MFP method I'd gather) to use the MFP multipliers rather than the TDEE charts that include exercise?

It seems if you are going to take any TDEE and subtract the exercise back out, you are now getting a value that is really only going to be useful doing it MFP method, since you must be adding exercise back in.

Because their multiplier's are based on new study research and are different than the TDEE charts.

Sedentary - 1.25
Lightly Active - 1.4
Active - 1.6
Very Active - 1.8

Ok, I can update those. And yes, I think that TDEE - ex it really is useful only for MFP settings (a pseudo RMR if you are really logging all exercise)

If I get this correctly, you are also suggesting giving a table with

(oTDEE - exercise) * activity factor = MFP non-exercise TDEE

I could also include an x cut for y lbs per week subtractor.

I'll see what I can build out without creating confusion.

Oh, I wouldn't go that far probably, but your point in description with graph about being perhaps more active than you thought you were, and selecting another activity level to better represent your non-exercise portion of day, I think is good point.

I'll also mention regarding the Fitbit adjustments that show up as exercise entries, those are not just the calorie burn from exercise, but the difference between MFP non-exercise maintenance, and Fitbit TDEE, which may or may not include exercise.

I've had days where really sedentary, except for the short intense workout. That was manually logged on Fitbit since it had bad low estimate on the burn (ie non-step based).

But when the compare with MFP happened, no adjustment, so it appeared no exercise. Or similar, big long workout, and indeed lazier rest of the day to recovery. The adjustment is easily 200 less than the workout was logged as.

Not sure if you handle those with caveats in the instructions, or figure someone with Fitbit is already getting their TDEE estimate there.

Whagwan83 · July 2014

As a stats geek thanks a lot for this tool!

Whagwan83 · July 2014

Hi, upon initial import I am getting the following errors:

ERROR: The most recent error number is 5. Its message text is :Invalid procedure call or argument.

ERROR: After location 0 in function Change_Axis_Scales. THe most recent error number is 1004. Its message text is: Unable to set the MaximumScale property of the Axis class. Please report this to EvgenuZentx

ERROR: After location 3 in function Set_All_Graphs. The most recent error number is 13. Its message text is: Type mismatch. Please report this to EvgenuZyntx.

Thanks!

Mischievous_Rascal · July 2014

Bumping for later. Thank you from the bottom of my number-filled heart. :flowerforyou:

jofjltncb6 · July 2014

Do you think it would be useful for the non-exercise TDEE that might help to decide to change your daily activity level (for those doing MFP method I'd gather) to use the MFP multipliers rather than the TDEE charts that include exercise?

It seems if you are going to take any TDEE and subtract the exercise back out, you are now getting a value that is really only going to be useful doing it MFP method, since you must be adding exercise back in.

Because their multiplier's are based on new study research and are different than the TDEE charts.

Sedentary - 1.25
Lightly Active - 1.4
Active - 1.6
Very Active - 1.8

Ok, I can update those. And yes, I think that TDEE - ex it really is useful only for MFP settings (a pseudo RMR if you are really logging all exercise)

If I get this correctly, you are also suggesting giving a table with

(oTDEE - exercise) * activity factor = MFP non-exercise TDEE

I could also include an x cut for y lbs per week subtractor.

I'll see what I can build out without creating confusion.

Oh, I wouldn't go that far probably, but your point in description with graph about being perhaps more active than you thought you were, and selecting another activity level to better represent your non-exercise portion of day, I think is good point.

I'll also mention regarding the Fitbit adjustments that show up as exercise entries, those are not just the calorie burn from exercise, but the difference between MFP non-exercise maintenance, and Fitbit TDEE, which may or may not include exercise.

I've had days where really sedentary, except for the short intense workout. That was manually logged on Fitbit since it had bad low estimate on the burn (ie non-step based).

But when the compare with MFP happened, no adjustment, so it appeared no exercise. Or similar, big long workout, and indeed lazier rest of the day to recovery. The adjustment is easily 200 less than the workout was logged as.

Not sure if you handle those with caveats in the instructions, or figure someone with Fitbit is already getting their TDEE estimate there.

I have similar experiences in my fitbit logging of exercise and have given this some thought as well. Strangely enough, you would actually increase the accuracy of the overall estimate by *reducing* the MFP assumed activity level (as this hands off the calculation to fitbit more quickly/often which for this purpose are assuming is more accurate than MFP in the TDEE assumption (especially on no/low-exercise days).

I can't imagine the extraction tool would be able to do anything to deal with this problem without pulling the data directly from fitbit.

Although, I suppose allowing negative adjustments from fitbit on MFP would handle this, right?

EvgeniZyntx · July 2014

Do you think it would be useful for the non-exercise TDEE that might help to decide to change your daily activity level (for those doing MFP method I'd gather) to use the MFP multipliers rather than the TDEE charts that include exercise?

It seems if you are going to take any TDEE and subtract the exercise back out, you are now getting a value that is really only going to be useful doing it MFP method, since you must be adding exercise back in.

Because their multiplier's are based on new study research and are different than the TDEE charts.

Sedentary - 1.25
Lightly Active - 1.4
Active - 1.6
Very Active - 1.8

Ok, I can update those. And yes, I think that TDEE - ex it really is useful only for MFP settings (a pseudo RMR if you are really logging all exercise)

If I get this correctly, you are also suggesting giving a table with

(oTDEE - exercise) * activity factor = MFP non-exercise TDEE

I could also include an x cut for y lbs per week subtractor.

I'll see what I can build out without creating confusion.

Oh, I wouldn't go that far probably, but your point in description with graph about being perhaps more active than you thought you were, and selecting another activity level to better represent your non-exercise portion of day, I think is good point.

I'll also mention regarding the Fitbit adjustments that show up as exercise entries, those are not just the calorie burn from exercise, but the difference between MFP non-exercise maintenance, and Fitbit TDEE, which may or may not include exercise.

I've had days where really sedentary, except for the short intense workout. That was manually logged on Fitbit since it had bad low estimate on the burn (ie non-step based).

But when the compare with MFP happened, no adjustment, so it appeared no exercise. Or similar, big long workout, and indeed lazier rest of the day to recovery. The adjustment is easily 200 less than the workout was logged as.

Not sure if you handle those with caveats in the instructions, or figure someone with Fitbit is already getting their TDEE estimate there.

I have similar experiences in my fitbit logging of exercise and have given this some thought as well. Strangely enough, you would actually increase the accuracy of the overall estimate by *reducing* the MFP assumed activity level (as this hands off the calculation to fitbit more quickly/often which for this purpose are assuming is more accurate than MFP in the TDEE assumption (especially on no/low-exercise days).

I can't imagine the extraction tool would be able to do anything to deal with this problem without pulling the data directly from fitbit.

Although, I suppose allowing negative adjustments from fitbit on MFP would handle this, right?

Couple of comments:

- observed TDEE (oTDEE) doesn't use exercise or burn data; it's what you eat and gain/lose in weight that is used. It assumes a constant relationship of 3500 for each lb gained/lost (which isn't exactly true). Therefore the calculation isn't impacted at all by the fitbit adjustment or errors in evaluating or recording exercise burns.

- by subtracting burns from oTDEE to create a "non-exercise" oTDEE we introduce those possible sources of error - fitbit corrections as exercise, burn data variability

The resulting non-exercise oTDEE can be used to set-up MFP custom Net Calories Consumed* but what happens with those extra bitfit calories?

Let's say that the fitbit is adding on 200 extra cals and exercises give 300 cals per day average. Let's build up an sample situation:

Settings = 2000 cals
oTDEE = 2500 cals
burns=500 (200+ fitbit, 300 recorded)

There wouldn't be an issue because the fitbit is only adding the extra cals missed from exercise and MFP setting. If the person recorded 400 exercise cals, the fitbit will only add 100 as it estimates the total burn and eliminates the exercise period - if the user wrote the correct duration when recording the exercise burn.)

Does this make sense? Do you guys see it otherwise?