|
| 1 | +# OIB Baseline Comparisons |
| 2 | + |
| 3 | +Documented below are the results of some tests of other baseline configurations available for Intune-managed devices. I documented the experice seen during an Autopilot deployment, the general post-provisioning user experience, and any policy or security issues identified. |
| 4 | + |
| 5 | +To conduct the tests I took an approach that is widely seen in this space, that being: |
| 6 | +* Baselines were imported "as-is" with no modifications made. |
| 7 | +* All policies were targeted at devices, rather than users. |
| 8 | + |
| 9 | +OIB data has been presented from **direct feedback from community members** who have implemented the baseline **in their own environments**. Other baseline tests have been conducted to map against those same feedback points to provide a reasonable and unbiased comparison. |
| 10 | + |
| 11 | +--- |
| 12 | + |
| 13 | +## OpenIntuneBaseline |
| 14 | +### Test Details |
| 15 | +* Baseline Version(s) Tested: |
| 16 | + * [OpenIntuneBaseline - Windows v3.3](/WINDOWS/README.md) |
| 17 | +* Tested on: |
| 18 | + * Windows 11 Enterprise 23H2 - 2024.08 B Security Update |
| 19 | + |
| 20 | +### Autopilot User Experience: |
| 21 | +* No reboot seen between Device and user Phase. |
| 22 | +* User required to pass 2rd MFA challenge to configure WHfB (not seen if skipping user ESP or ESP takes <15 minutes). |
| 23 | + |
| 24 | +### General User Experience: |
| 25 | +* Edge automatically configured and signed-in. |
| 26 | +* Great productivity experience: |
| 27 | + * Outlook auto sign-in using primary SMTP address |
| 28 | + * OneDrive KFM automatically configured and signed-in. |
| 29 | + * Office apps do not prompt first-run wizard. |
| 30 | + |
| 31 | +### Helpdesk Support Experience: |
| 32 | +* UAC allowed within the user session, able to use LAPS to diagnose or resolve issues. |
| 33 | + |
| 34 | +### Policy Issues Seen: |
| 35 | +* Two transient policy error due to Defender Additional Configuration & Defender Tamper Protection ([documented here](/WINDOWS/KNOWNISSUES.md)) - Resolved after reboot. |
| 36 | + |
| 37 | +### Security Issues Identified: |
| 38 | +* None |
| 39 | + |
| 40 | +### Admin Impact Summary: |
| 41 | +* Simple and quick implementation of a secure, "known-good" baseline. |
| 42 | +* Known issues are well documented. |
| 43 | +* Policies are granular and easy to understand and expand on. |
| 44 | +* Community-driven feedback and support available. |
| 45 | + |
| 46 | +--- |
| 47 | + |
| 48 | +## Intune Security Baseline |
| 49 | +### Comparison Rationale |
| 50 | +In blogs, documentation, and presentations, Microsoft regularly states that the Intune Security Baseline is the recommended starting point for securing Windows devices. |
| 51 | + |
| 52 | +### Test Details |
| 53 | +* Baseline Version(s) Tested: |
| 54 | + * [Security Baseline for Windows 10 and later - Version 23H2](https://learn.microsoft.com/en-gb/mem/intune/protect/security-baseline-settings-mdm-all?pivots=mdm-23h2) |
| 55 | + * [Microsoft Defender for Endpoint Security Baseline - Version 24H1](https://learn.microsoft.com/en-gb/mem/intune/protect/security-baseline-settings-defender?pivots=mde-v24h1) |
| 56 | + * [Security Baseline for Microsoft Edge - Version 117](https://learn.microsoft.com/en-gb/mem/intune/protect/security-baseline-v2-edge-settings?pivots=edge-v117) |
| 57 | +* Tested on: |
| 58 | + * Windows 11 Enterprise 23H2 - 2024.08 B Security Update |
| 59 | + |
| 60 | +### Autopilot User Experience: |
| 61 | +* Reboot seen between Device and user Phase: |
| 62 | + * User needs to re-input user credentials. |
| 63 | + * User required to re-pass MFA (if not skipping user ESP). |
| 64 | +* User required to pass 3rd MFA challenge to configure WHfB (or 2nd if skipping user ESP). |
| 65 | +* Default password length of 14 which also impacts WHfB PIN! |
| 66 | + |
| 67 | +### General User Experience: |
| 68 | +* You've been forced to use a 14 character PIN which you've probably set the same as your password. |
| 69 | +* Poor initial Edge user experience: |
| 70 | + * Account automatically identified but user asked for sign in |
| 71 | + * Large amount of initial setup wizard prompts. |
| 72 | +* Suboptimal productivity experience: |
| 73 | + * Outlook identifies user account but does not get automatically configured. |
| 74 | + * No OneDrive configuration, user has to log in and configure manually. |
| 75 | + * Prompted by Office first-run wizard to set file types. |
| 76 | + |
| 77 | +### Helpdesk Support Experience: |
| 78 | +* UAC blocked within the user session, making it difficult to diagnose or resolve issues. |
| 79 | + |
| 80 | +### Policy Issues Seen: |
| 81 | +* Windows and Defender Security Baselines (still) conflict with each other. |
| 82 | + |
| 83 | +### Security Issues Identified: |
| 84 | +* No BitLocker configuration, leaving device unencrypted. |
| 85 | + |
| 86 | +### Admin Impact: |
| 87 | +* Applying other policies difficult due to monolithic nature of the security baseline. |
| 88 | +* Tracking down and resolving conflicts between the security baselines is time-consuming. |
| 89 | +* Support relies on Microsoft documentation or available paid support channels. |
| 90 | + |
| 91 | +--- |
| 92 | + |
| 93 | +## Center for Internet Security (CIS) Benchmark |
| 94 | +### Comparison Rationale |
| 95 | +The CIS Benchmarks are widely used across the industry and are considered a "gold standard" for device security configuratio. |
| 96 | + |
| 97 | +### Test Details |
| 98 | +* Baseline Version Tested: |
| 99 | + * [CIS Microsoft Intune for Windows 11 Benchmark v3.0.1](https://workbench.cisecurity.org/benchmarks/16853) (CIS Workbench login required) |
| 100 | + * Note: Build Kit requires CIS SecureSuite subscription |
| 101 | +* Tested on: |
| 102 | + * Windows 11 Enterprise 23H2 - 2024.08 B Security Update |
| 103 | + |
| 104 | +### Autopilot User Experience: |
| 105 | +* Reboot seen between Device and user Phase: |
| 106 | + * User had to press CTRL+ALT+DEL. |
| 107 | + * User needs to re-input user credentials. |
| 108 | + * User required to re-pass MFA (if not skipping user ESP). |
| 109 | +* User required to pass 3rd MFA challenge to configure WHfB (or 2nd if skipping user ESP). |
| 110 | + |
| 111 | +### General User Experience: |
| 112 | +* Configured to not remember user credentials so every logon requires full credential input even if WHfB is configured. |
| 113 | +* Poor initial Edge user experience: |
| 114 | + * Account automatically identified but user asked for sign in |
| 115 | + * Large amount of initial setup wizard prompts. |
| 116 | +* Suboptimal productivity experience: |
| 117 | + * Outlook identifies user account but does not get automatically configured. |
| 118 | + * No OneDrive configuration, user has to log in and configure manually. |
| 119 | + * Prompted by Office first-run wizard to set file types. |
| 120 | + |
| 121 | +### Helpdesk Support Experience: |
| 122 | +* UAC blocked within the user session, making it difficult to diagnose or resolve issues. |
| 123 | + |
| 124 | +### Policy Issues Seen: |
| 125 | +* **CIS (L1) Section 1 - 3.9.1.1 - Windows 11 Intune 3.0** - _(L1) Ensure 'MSS: (AutoAdminLogon) Enable Automatic Logon (not recommended)' is set to 'Disabled'_ |
| 126 | + * Setting completely breaks Autopilot if not removed. |
| 127 | +* **CIS (L1) Windows Update - Windows 11 Intune 3.0.1** - |
| 128 | + * Conflicted with pre-existing Windows Update for Business Ring settings. |
| 129 | + |
| 130 | +### Security Issues Identified: |
| 131 | +* BitLocker policy does not function, leaving device unencrypted. |
| 132 | +* Some security gaps without implementing additional benchmarks (e.g. Edge, Internet Explorer). |
| 133 | +* Conflicts in Windows Update settings leads to unpredictable update behaviour. |
| 134 | + |
| 135 | +### Admin Impact: |
| 136 | +* Does not work out-of-the-box with Autopilot! |
| 137 | +* Applying other policies potentially difficult due to haphazard existing policy groupings. |
| 138 | +* Tracking down and resolving conflicts between the security baselines is time-consuming. |
| 139 | +* Support relies on vendor documentation or available paid support channels. |
| 140 | + |
| 141 | +--- |
0 commit comments