Skip to content
Maintankadin

A Call to Arms - MoP Mechanics Testing

theckhd
Wed Mar 21, 2012 10:48 am

A Call to Arms - MoP Mechanics Testing

Accurate modeling is predicated on having solid data. Just as we did in Cataclysm, we'll need to test various aspects of our mechanics in order to ensure the models give us the best possible predictions.

The goal of this thread will be to ask and answer questions about game mechanics through empirical testing, in a very similar vein to the incredibly useful EJ thread (update link for MoP version). I'll keep a running list of the current parse requests, issues, and links to the data relevant to those issues. In addition, I highly encourage people to participate in the EJ testing as well. This thread will be focused solely on paladin-specific issues, but many of the EJ test results will be directly relevant to us.


When posting data, please include as much information as is relevant to the problem at hand. Most requests will ask for the specific information needed, but more never hurts. As a rule of thumb, try to include the following information:
Game build # (i.e. 4.3.2.1023) AP, SP, Weapon tooltip damage (i.e. x-y), weapon tooltip speed (i.e. 2.6), weapon name (so I can double-check that you haven't given me paper doll values), Glyphs, character level, dummy level.

Many of these tests need to be done in very controlled environments to make sure that the analysis is accurate. It's generally good practice to find an isolated dummy and make sure they don't gain any external debuffs during testing (unless we specifically request a particular debuff, of course).

If you have questions about World of Logs, please take a look at the "WoL How-To" section below. If all else fails, uploading a raw combat log with your post is acceptable as well.
theckhd
Wed Mar 21, 2012 10:49 am
Current Parse Requests:
Test #42: Glyph of Protector of the Innocent
  • Level: 90
  • Gear: any, ideally with lots of STR (high SP)
  • Target: any friendly target, preferably no buffs/debuffs
  • Attack Sequence: with SoI active, build HP on a dummy and cast WoG on a friendly target. Repeat with SoI off (separate log, ideally)
  • Goal: 200 WoG casts (1 HP is fine); 100 w/SoI and 100 w/o
  • Report: upload log, note total SP

Test #47: RPPM - scaling with attack speed
  • Gear : naked, but having equipped a 1H weapon* enchanted with Elemental Force (*avoid those with haste rating). Faster weapons are preferable.
  • Seal : none.
  • Buffs : the relevant buff class (DPS DK, Enh Shaman, any Rogue).
  • Target : any low-level target dummy.
  • Attack sequence : just autoattacks (no positional requirement).
  • Goal : at least 3h of autoattacks.

Test #49: RPPM - delta_t
  • Gear : naked, but having equipped a FFS enchanted with Elemental Force (use exactly that weapon, not any other alternative).
  • Seal : Insight.
  • Buffs : none.
  • Target : any low-level target dummy.
  • Attack sequence : only autoattacks and CS (no positional requirement).
  • Methodology : using a swing timer addon, precisely position the CS casts immediately after autoattacks.
  • Goal : at least 200 synchronized CS casts.
theckhd
Wed Mar 21, 2012 10:49 am
Testing Log: Current and Resolved Issues:

  1. [many] Ability types - many logs indicating that CS/HotR(phys)/SotR are melee, HotR(nova)/AS/J/HW/Cons are spell.
  2. [5.0.1.15508] HotR/HammerNova hit/miss mechanics - HammerNova automatically hits all enemies in range if HotR(phys) succeeds.
  3. [5.0.4.15913] Weapon enchant proc triggers - CS/HotR/J/AS confirmed as Dynamic Enchant triggers, WoG, SotR do not.
  4. [5.0.4.15913] Weapon enchant proc rates - WS is 1 PPM random, EF is 3 PPM, DS is 1PPM, RS unknown.
  5. [5.0.1.15699] Holy Wrath as an enchant proc trigger - Holy Wrath triggers dynamic effects, currently resetting swing timer
  6. [5.0.4.15913] Elemental Force buff/debuff dependence - Unaffected by Weak Armor/Phys Vuln, affected by global modifiers (AW/TotT), affected by Magic Vulnerability
  7. [5.0.1.15464] Seal of Insight proc rate - 15 PPM, 0.15*(AP+SP)
  8. [5.0.1.15464] Seal of Truth mechanics - 14% unnormalized weapon damage, only CS/SotR/melee proc or stack censure
  9. [5.0.1.15544] Weapon normalization - HotR(phys) unnormalized, CS/SotR normalized.
  10. [5.0.1.15508] EF/Cons as dynamic effect triggers - EF cast/ticks and HammerNova trigger spell-proc effects, Consecration cast/ticks are not a trigger.
  11. [5.0.1.15508] Grand Crusader - Only procs from successful attacks
  12. [5.0.1.15508] Avenging Wrath - Cons updates on-the-fly, Censure only updates on refresh/reapply.
  13. [5.0.1.15464] Seal of Righteousness damage, procs - 5% normalized weapon damage, automatically connects on all targets in range
  14. [5.0.1.15544] J, AS spell confirmation - J/AS miss even at melee hit cap
  15. [5.0.1.15508] expertise->Spell Hit behavior - expertise continues to contribute spell hit beyond the dodge cap
  16. [5.0.1.15544] Sanctity of battle - uses melee haste now, see #37
  17. [5.0.1.15544] Seal crit mechanics - SoT, SoR appear to use melee crit chance.
  18. [5.0.1.15544] Seal of Insight triggers - Melee abilities (CS/HotR/SotR) proc SoI, spells (AS/J/HW/Cons) do not.
  19. [5.0.1.15544] Seal of Righteousness triggers - Melee abilities (CS/HotR/SotR) proc SoR, spells (AS/J/HW/Cons) do not.
  20. [5.0.1.15544] Sacred Shield as a trigger for dynamic effects - SS does not trigger spell procs
  21. [5.0.4.16004] Holy Prism as a trigger for dynamic effects - HPr is not a trigger.
  22. [5.0.1.15544] Scaling with haste/crit for EF's over-time effect - Uses spell crit, snapshots haste at time of cast.
  23. [5.0.1.15544] Divine Purpose - finishers act as triggers on cast rather than on connect
  24. [5.0.1.15544] Censure as a trigger for dynamic effects - Censure procs dynamic spell trigger effects
  25. [5.0.1.15589] J/AS crit scaling - J uses spell crit
  26. [5.0.1.15589] Glancing Blows - work as on 4.3 live
  27. [5.0.4.15961] Hammer of Wrath ability type - HoWrath is a ranged ability, can miss and be dodged but not parried.
  28. [5.0.1.15781] Ability AP scaling 2 3 - Detailed results below
  29. [5.0.1.15781] Glancing mechanics - Attacks are on a two- or three-roll system. AA on 2-roll (hit/crit, then block), other on 3-roll (hit/miss, crit, block)
  30. [5.0.1.15781] Armor and Physical Damage Reduction - Armor coefficient at 90 is ~25050, mob armor for L86-91
  31. [5.0.1.15781] Base Stats/Attributes - see simC data
  32. [5.0.1.15589] Avoidance Diminishing Returns Formula - DR equation has same form as Cata, new coefficients (k=0.885, C_d=65.631440, C_p~232)
  33. [5.0.3.15961] - L90 Talent hit/miss mechanics - LH is Cons-like, HPr does not miss, ES binary hit/miss on cast.
  34. [5.1.0.16357] - Light's Hammer target cap - Affected by standard AoE target cap.
  35. [5.0.4.15929] - HotR mechanics - physical portion now uses normalized weapon damage, nova bugged
  36. [5.0.4.15929] - Judgment mechanics - Melee attack, triggers Seals/Censure, Miss/Dodge/Parry
  37. [5.0.4.15961] - Sanctity of Battle - not affected by spell haste buffs
  38. [5.0.5.16057] - Seal of Insight interactions - WoG affected, EF/EFHoT now do as well, HPr/LH are not, ES is not.
  39. [5.0.4.15972] - Glyph of Harsh Words interactions - Harsh Words does not benefit from SoI or BoG.
  40. [5.0.4.15972] - Holy Avenger and Grand Crusader - Grand Crusader grants 3 HP during Holy Avenger
  41. [5.0.5.] - Expertise->Spell Hit conversion - hit or expertise above 7.5% does count towards spell hit cap (i.e. 7% hit 8% exp works).
  42. [build] - Glyph of Protector of the Innocent - see parse request
  43. [5.1.0.16357] - SoI and Avenging Wrath - SoI has no effect on GoAW
  44. [5.0.4.16016] - Glyph of Word of Glory - multiplicative with global modifiers
  45. [5.1.0.16357] - 4p T14 set bonus - WoG benefit multiplicative with SoI
  46. [5.0.4.16016] - Glyph of WoG refresh mechanics - duration not additive, weaker buff will replace stronger
  47. [build] - RPPM attack speed scaling - see parse request.
  48. [5.0.5.] - RPPM effects scale as advertised with spell haste
  49. [build] - RPPM and \delta t - see parse request
  50. [5.1.0.16357] - SotR does not update upon refresh with dynamic mastery effects
  51. [5.1.0.16357] - SoI buffed to 20 PPM
  52. [5.2 PTR] - Consecration formula - (914+0.16*SP) damage per tick, 9 ticks
  53. [5.2 PTR] - EF ticks doubled - (1016+0.117*SP) per tick
  54. [5.1.0.16357] - Consecration - Obeys standard DoT refresh mechanics, but with a fixed 1-second tick interval
theckhd
Wed Mar 21, 2012 10:49 am
Compiled Results on specific topics


Seal Mechanics

  • Seal of Insight
    • 0.15*(AP+SP)
    • 20 PPM (not haste normalized)
    • Triggers: melee, others NYV
    • Not Triggers: NYV
  • Seal of Truth
    • 2.5% un-normalized weapon damage ( 0.14*(base_wdmg+AP/14.*base_wspeed))
    • Automatically connects
    • Triggers: CS, SotR, J, melee
  • Seal of Righteousness
    • 9% normalized weapon damage ( 0.5*(base_wdmg+AP/14*2.4))
    • Automatically hits all targets in area of effect
    • Triggers: CS, SotR, J, melee

Ability Mechanics

  • CS is melee type (miss/dodge/parry), does 125% normalized weapon damage + 791.
  • HotR is melee type (miss/dodge/parry), does 20% normalied weapon damage
  • HammerNova automatically connects if HotR does, does 35% normalized weapon damage.
  • SotR is melee type (miss/dodge/parry), does 836+0.617*AP damage.
  • J is special (melee miss, cannot be dodged/parried), does 623+0.328*AP+0.546*SP.
  • HoW is ranged type (melee miss/dodge, cannot be parried), does 1838+1.610*SP.
  • AS is spell type (spell miss), does 4488+0.21*SP+0.545*AP.
  • Cons is spell type (spell miss), does 924.3+1.62*SP.
  • HW is spell type (spell miss), does 4300+0.91*SP.
  • Censure automatically succeeds, application is NYV (melee w/o dodge/parry suspected), does 107+0.094*SP damage per stack
  • Light's Hammer is spell type (spell miss per tick), does 3630+0.321*SP damage and 2512+0.222 healing per tick (8 ticks)
  • Holy Prism is special (does not miss), does 16136+1.428*SP damage/healing to target, 10882+0.962*SP healing/damage in AoE
  • Execution Sentence is spell type, (spell miss on cast), does 12989+5.936*SP total
theckhd
Wed Mar 21, 2012 10:50 am
WoL How-To:

I've started a maintankadin guild on World of Logs so that we have one central repository of uploaded logs. Anyone who's running dungeons or doing testing on beta is encouraged to record their combat log and upload. Creating a WoL account is quick and painless, as is the uploading process. In fact, if you prefer, you can just run the Java client in the background and "live log," which will upload as you play.

To join the guild, register for an account. You'll have to activate the account by clicking a link in the e-mail they send you. At that point, you can log in, and you will be asked if you want to join a guild. The guild is maintankadin on US-Blackrock (your actual region and server are irrelevant). Send me a PM here to let me know that you've requested to join, so I can log in and approve your application. I'll approve everyone who joins and give them upload permissions.

Logging is easy:
WWS wrote:Start World of Warcraft and enter the game. At the beginning of the raid, dungeon or solo testing session you want to create a report for, type /combatlog into the chat box, you should get a response saying "Combat being logged to Logs/WoWCombatlog.txt". When you're done with the raid, dungeon or solo testing session type /combatlog again. You'll get another response saying "Combat logging disabled". Log out of WoW and your combat log should be in the /World of Warcraft/Logs/ folder.


Uploading is simple - first download the client and run it. Put in your username/pass and your logs directory. Click on "Open File" and choose the WoWCombatLog.txt file. It'll take a bit of time to parse the log (the longer the log, the longer it takes), and eventually you'll get a screen with a graph and an "upload" button - just click on Upload and it will send the parse to the server. If you want to send only part of the log, you can use the graph to select the portions you want to upload.

Alternatively, you can upload-as-you-go by running the client before you record and clicking "Start a Live Report Session." This will watch the combat log as you play and upload to the server in small chunks whenever there's a break in the action.
theckhd
Thu Mar 22, 2012 5:51 am

Re: A Call to Arms - MoP Mechanics Testing

I realized that it would be useful to have a glossary of all previous test constraints. Unfortunately, I didn't realize this until well after I had deleted most of them. From now on, I'm going to copy all new ones here and keep a running list. The earlier post will just contain ones that we haven't run yet.

Glossary of old parse requests

Test #34: Light's Hammer target cap
  • Level: 90
  • Gear: Any
  • Target: A group of exactly N mobs. Mob level is irrelevant.
  • Attack Sequence: Cast a single Light's Hammer once all mobs are in range and grouped up.
  • Goal: Repeat this for N=5, 7, 9, 10, 11, 15.
  • Report: build, AP/SP, upload combat log. Preferably a different log for each N.

Test #41: Expertise->Spell Hit conversion
  • Level: 90
  • Gear: any, but with exactly 0% hit and 15% expertise
  • Target: boss-level dummy (if you can find 2+ boss-level dummies together, all the better)
  • Attack Sequence: Consecrate until the world ends
  • Goal: 20 Consecration casts, or the first missed tick.
  • Report: upload log

Test #42: Glyph of Protector of the Innocent
  • Level: 90
  • Gear: any, ideally with lots of STR (high SP)
  • Target: any friendly target, preferably no buffs/debuffs
  • Attack Sequence: with SoI active, build HP on a dummy and cast WoG on a friendly target. Repeat with SoI off (separate log, ideally)
  • Goal: 200 WoG casts (1 HP is fine); 100 w/SoI and 100 w/o
  • Report: upload log, note total SP

Test #43: SoI and Glyph of Avenging Wrath
  • Level: any
  • Gear: high-stamina
  • Glyphs: GoAvengingWrath, obviously
  • Target: none
  • Attack sequence: Cast SoI, cast Avenging Wrath
  • Report: total HP, upload log

Test #45: 4pT14
  • Level: 90
  • Gear: 4pT14
  • Target: low-level dummy
  • Attack Sequence: with SoI active, build HP and cast 1-HP WoGs on yourself. Repeat with SoI inactive
  • Goal: 200 WoGs (100 w/SoI, 100 w/o)
  • Report: SP, upload log

Test #47: RPPM - scaling with attack speed
  • Gear : naked, but having equipped a 1H weapon* enchanted with Elemental Force (*avoid those with haste rating). Faster weapons are preferable.
  • Seal : none.
  • Buffs : the relevant buff class (DPS DK, Enh Shaman, any Rogue).
  • Target : any low-level target dummy.
  • Attack sequence : just autoattacks (no positional requirement).
  • Goal : at least 3h of autoattacks.

Test #48: RPPM - scaling with spell haste
  • Gear : naked, but having equipped a 1H weapon* enchanted with Elemental Force (*avoid those with haste rating). Faster weapons are preferable.
  • Seal : Insight.
  • Buffs : the relevant buff class (Shadow Priest, Elem Shaman, Balance Druid).
  • Target : any low-level target dummy.
  • Attack sequence : just autoattacks (no positional requirement).
  • Goal : at least 3h of autoattacks.

Test #49: RPPM - delta_t
  • Gear : naked, but having equipped a FFS enchanted with Elemental Force (use exactly that weapon, not any other alternative).
  • Seal : Insight.
  • Buffs : none.
  • Target : any low-level target dummy.
  • Attack sequence : only autoattacks and CS (no positional requirement).
  • Methodology : using a swing timer addon, precisely position the CS casts immediately after autoattacks.
  • Goal : at least 200 synchronized CS casts.

Test #50: SotR and dynamic mastery effects
  • Gear: any, preferably low dodge, using one or two trinkets that have mastery on-use effects. Bring a melee-dealing friend with high AP but using either a Dirk or a Club. No dual-wielders.
  • Seal: Insight
  • Buffs: none
  • Talents: Holy Avenger
  • Target: any dummy
  • Attack sequence: regular rotation on the dummy, can stick to just CS/J/AS for holy power and SotR as finisher
  • Methodology: Have your friend auto-attack you from behind while you do your rotation on the dummy. What I'm looking for is two specific situations:
    1. With SotR buff not already active, use the mastery trinket effect, wait 5 seconds, then use Holy Avenger and maintain SotR until both HA and the mastery buff have ended. Continue recording the combat log for another 20-30 seconds afterward.
    2. With SotR buff not already active, use Holy Avenger and begin your SotR maintenance. About 12 seconds into HA's duration (6 seconds left on the buff), use the mastery trinket effect. Continue maintaining SotR as long as possible once HA has ended, and record an additional 20-30 seconds after the mastery buff expires.
  • Goal: One parse for each of the two situations described above. Upload combat log, preferably a separate one for each test. If you have to combine them into one, use some sort of signaling spell in-between so I can properly distinguish the two (i.e. cast Consecration once or twice in-between, and at no other time in the test).
Fetzie
Thu Mar 22, 2012 5:54 am

Re: A Call to Arms - MoP Mechanics Testing

Ah, I had missed that ShoR is now off the GCD. That is going to take some getting used to...

Anywho, Annual Pass holder has app'ed to the maintankadin guild, check your PM inbox :)
Cema
Thu Mar 22, 2012 1:42 pm

Re: A Call to Arms - MoP Mechanics Testing

Give me a beta Key and I'll give you tons of logs ^^
Sabindeus
Thu Mar 22, 2012 9:10 pm

Re: A Call to Arms - MoP Mechanics Testing

theck for test #1 how am I supposed to cast Judgement without a seal? :P
theckhd
Fri Mar 23, 2012 7:07 am

Re: A Call to Arms - MoP Mechanics Testing

Sabindeus wrote:theck for test #1 how am I supposed to cast Judgement without a seal? :P

Oops. I didn't realize it was still linked to seals. Insight would be best for that, I'll update the request.
theckhd
Fri Mar 23, 2012 7:10 am

Re: A Call to Arms - MoP Mechanics Testing

Jaannaa wrote:Test #7: Seal of Insight proc rate

Game Build:
AP: 7859
SP: 3908
Weapon: Dragonstrike (2.7) (http://www.wowhead.com/item=28439)
Glyphs: None
Toon level: 85
Dummy level: 60

WoL: http://www.worldoflogs.com/reports/y8s5 ... details/0/


What was giving you Haste?

<edit> 314 SoI procs out of 451 melee swings. Way too many for it to be a flat 15% per attack.

PPM calculation: 15 PPM * (2.7/60) = 0.6750 proc rate (0.675*451=304 expected procs).
Using the Normal Approximation Method, 314 successes in 451 melee swings gives a 95% confidence interval of [0.6538 0.7387]. Seems reasonable to assume that SoI is still 15 PPM.
1765 healing per proc confirms that it's still 0.15*(AP+SP).
Rhiannon
Fri Mar 23, 2012 7:39 am

Re: A Call to Arms - MoP Mechanics Testing

He linked it - Weapon: Dragonstrike (2.7) (http://www.wowhead.com/item=28439)

Using a weapon with a random haste proc is probably not a great idea for testing proc rates.
theckhd
Fri Mar 23, 2012 7:45 am

Re: A Call to Arms - MoP Mechanics Testing

Argh, yeah. That said, the haste proc doesn't change much for SoI, since I'm pretty sure most PPM effects are not haste-normalized.

What game build are we at now?
Sabindeus
Fri Mar 23, 2012 8:46 am

Re: A Call to Arms - MoP Mechanics Testing

theckhd wrote:
Sabindeus wrote:theck for test #1 how am I supposed to cast Judgement without a seal? :P

Oops. I didn't realize it was still linked to seals. Insight would be best for that, I'll update the request.


Ok, I'll see what I can do tonight/this weekend.

I have to say though that this may not be the best time to test mechanics changes... The blog says the focus now is on testing the Pandaren 1-10 experience.
theckhd
Fri Mar 23, 2012 10:20 am

Re: A Call to Arms - MoP Mechanics Testing

Mechanics changes are about all we can test right now. Things like seal behavior and triggers are unlikely to change with tuning. Damage values are much more volatile (and frankly, I'm not even interested in them until lvl 90 in the first place).
tlitp
Fri Mar 23, 2012 1:35 pm

Re: A Call to Arms - MoP Mechanics Testing

1. Weapon normalization.
Grab a DS and a BA, use the default gear set, cast 2 SoT and 2 HotR on a low-level dummy (one for each weapon, respectively). Report if the damage values are dissimilar or not.

2. EF and Cons as triggers for dynamic effects.
Enchant any weapon with HS, find any isolated low-level dummy (no clustering, you must hit only one target), proceed to pound it with a sequence of HotR>Eternal Flame (1 HoPow). Use SoI and autoattacks freely. Stop after 30 EF casts (or after the first proc, whichever happens first) and upload the log.
Repeat the procedure using only AAs and Cons. Stop at 50 Cons casts, irregardless of the occurring procs (if any).

3. GrCr.
Being naked (0 hit/exp), using SoI, cast CS on a boss-level dummy. Stop after 30 CS casts and upload the log.

4. AW.
Stack Censure on a low-level dummy, cast a Cons, interrupt any attacks, wait ~3s, cast AW. Report if Cens/Cons update their damage values on-the-fly or not.

5. SoR.
Being naked (0 hit/exp), using SoR, grab a DS and pound a boss-level dummy from the front. Use only autoattacks. Position yourself so that you're able to cleave SoR (a second target in proximity). Stop after 500 AAs (~10 mins) and upload the log.
Jaannaa
Fri Mar 23, 2012 3:39 pm

Re: A Call to Arms - MoP Mechanics Testing

Rhiannon wrote:Using a weapon with a random haste proc is probably not a great idea for testing proc rates.


My bad >.<

I tested again...

Test #7: Seal of Insight proc rate

Build: 5.0.1 (15464)
AP: 7859
SP: 3908
Weapon: Venerable Dal'Rend's Sacred Charge (2.8) (http://www.wowhead.com/item=42945)
Glyphs: None
Toon level: 85
Dummy level: 60 (attacked from behind)

WoL: http://www.worldoflogs.com/reports/eku7 ... details/0/
theckhd
Fri Mar 23, 2012 6:51 pm

Re: A Call to Arms - MoP Mechanics Testing

Jaannaa wrote:
Rhiannon wrote:Using a weapon with a random haste proc is probably not a great idea for testing proc rates.


My bad >.<

I tested again...

Test #7: Seal of Insight proc rate

Build: 5.0.1 (15464)
AP: 7859
SP: 3908
Weapon: Venerable Dal'Rend's Sacred Charge (2.8) (http://www.wowhead.com/item=42945)
Glyphs: None
Toon level: 85
Dummy level: 60 (attacked from behind)

WoL: http://www.worldoflogs.com/reports/eku7 ... details/0/

278 procs out of 420 attacks.
Expected proc rate for 15 PPM is 15*2.8/60=0.7000
Observed proc rate is p=0.6619, 95% CI is [0.6167 0.7071]
tlitp
Sat Mar 24, 2012 12:57 am

Re: A Call to Arms - MoP Mechanics Testing

tlitp wrote:2. EF, HW, Cons as triggers for dynamic effects.
Enchant any weapon with HS, find any isolated low-level dummy (no clustering, you must hit only one target), proceed to pound it with a sequence of HotR>Eternal Flame (1 HoPow). Use SoI and autoattacks freely. Stop after 30 EF casts (or after the first proc, whichever happens first) and upload the log.
Repeat the procedure using only AAs and Cons. Stop at 50 Cons casts, irregardless of the occurring procs (if any).

Repeat the procedure for HW too. Stop at 30 casts or the first proc.

tlitp wrote:3. GrCr.
Being naked (0 hit/exp), using SoI, cast CS on a boss-level dummy. Stop after 30 CS casts and upload the log.

Partly a typo, partly not noticing that GrCr is back to 20% in the latest beta build. The target is 120 casts (~9 mins). Sorry for the confusion.
Sabindeus
Sat Mar 24, 2012 11:09 pm

Re: A Call to Arms - MoP Mechanics Testing

http://dl.dropbox.com/u/294821/rotation-test.log.txt

Test #1: General Rotation

Build: 5.0.1 (15464)
AP: 563
SP: 260
Weapon: Longsword
Glyphs: None
My level: 85
Dummy level: Boss (attacked from behind)

Notes:
- My character sheet has the following to say:
Hit Chance: 0%, Miss chance against 88/Skull: 7.50%
Expertise: 1% (from Human racial) Dodge and Parry chance against 88/Skull: 6.50%
- Shield of the Righteous is off the global cooldown (Apparently you all were aware of that but I wasn't so I thought that was significant)
- Holy Wrath has a 9s cooldown. I didn't see it in your list of things to cast so I only started casting it later on.


where can I find 3 dummies close enough to test HotR?
tlitp
Sat Mar 24, 2012 11:38 pm

Re: A Call to Arms - MoP Mechanics Testing

For the moment we're interested in #2 and #8-13. Do note the updated #10-11. As the boss-level dummies seem to be hardcoded at 93 on the beta, #11 is particularly attractive.

We're also interested in Sanctity of Battle. Stuff haste/attack speed wherever possible (spell haste, melee attack speed, haste rating, but no Bloodlust-type effects), and then cast a few CS/HoTR on cooldown; I assume the tooltip won't be "working as intended". Report latency, haste rating, upload the log.
Mirawen
Sun Mar 25, 2012 10:46 am

Re: A Call to Arms - MoP Mechanics Testing

I'm going to have a look at some stuff, probably tonight. Do you want WoL parses, or are raw logs ok?
theckhd
Sun Mar 25, 2012 11:26 am

Re: A Call to Arms - MoP Mechanics Testing

Something seems funny with Sabin's log. Unfortunately, there are no parries - that's my fault, I should have specified attacking from the front (the whole point of this test is to determine what types of avoidance apply to each ability). However, even beyond that, there are some oddities.

Here are the hit/dodge/miss rates for the different abilities:
Code: Select all
  Percentage
Abil  Total  Hit    Dodge  Miss
SotR   92    72.83  14.13  13.04
CS    267    70.41  19.48  10.11
AS    100    31.00   0.00  69.00
J     183    27.87   0.00  72.13
HW     42    33.33   0.00  66.67
Cons  909    30.69   0.00  69.31
Melee 579     0.00  19.34  13.99  (66.67% glancing)


There are a few things of note here. The formula for miss/dodge/parry chance is 3% + 1.5% * (npc_level - player_level). For a 93, that should be 15% dodge/parry/block. Spell miss is 6% + 3% * (npc_level - player_level), which should be 30%. Since Sabin has 1% expertise from racials, we'd expect 14% dodge/parry, 15% melee miss, and 29% spell miss.

The low sample sizes make it tough to draw too many conclusions, because the 95% CI is about +/- 5%. CS's dodge and miss rates fall just outside the CI, but on different sides. However, we're seeing similar dodge results from the melee data. It may be that there's an additional bump for bosses 4+ levels higher.

This is more apparent from the Cons data, which should have a 29% miss rate. From the data, the 95% confidence interval is [66.31% 72.31%] - still a wide range, but way off. Again, we're probably seeing some sort of discontinuity in the formula for level differences greater than 4.

The most curious aspect, however, is the J and AS data. Despite the low sample size, the CI for J misses is [55.13% 82.87%], way over anything we're observing for melee. The fact that J and AS both match the Consecration data strongly suggests that these have been changed from melee attacks that cannot be dodged/parried to spells.

Unfortunately, to narrow down the percentages more finely, we'll need sample sizes of ~5k casts, which is a bit excessive, but possible to do in batches (i.e. if multiple people submit logs of several hundred casts). However, it's not necessary (or useful) to collect this data against a 93 target, since we're rarely going to care about bosses 8 levels higher. Ideally we'd want to test against a level 88 (or a level 82 paladin against an 85 dummy). So let's put this on hold unless someone finds one of those two special circumstances.

I'm going to update test #1 to make it clearer and more specific, and add a test for conclusively determining the nature of J/AS.