Polymer electrolytes are an important class of materials in enabling solid-state batteries, which have the potential to exceed 400 Wh/kg energy density. Despite significant advancements in their lithium-ion transport and mechanical properties over the last two decades, the integration and testing of these novel electrolyte materials into functioning cells with the electrode loadings and dimensions required to meet the cell-level energy density goals have been limited. Here, through multiple representative examples, we demonstrate the need of testing in close to practical cell conditions for a faster and more reliable evaluation of polymeric electrolytes. In particular, the need for testing with thin lithium anodes and practical cycling capacities is demonstrated for evaluation of their lithium-metal interfacial stability and dendritic resistance, respectively, and a testing protocol is suggested. The guidelines presented here will also apply to testing of other solid electrolytes for solid-state batteries.