2.3.
| CC Work Session |
| Meeting Date: | 05/28/2024 |
| Primary Strategic Plan Initiative: | {ud_pd2} |
Information
Title:
2024 Community Survey Direction
Purpose/Background:
With the assistance of Polco, the Ramsey Community Survey has been live since April 12th. The survey consists of mailing 3,000 random properties postcards with a unique online survey code and then following up with a paper version of the survey. On April 20th (Saturday) we were informed of incorrect rating headings for question 13 by one of these random properties. Question 13 is one of our custom questions related to rating new amenities in the community (parks, trails, community center, splash pad, etc). The ratings were corrected on April 22nd (Monday). This was corrected quite quickly by Polco once being informed of the error. This made staff question whether Ramsey staff’s review of the first final survey instrument was approved with the error. It was not, indicating that a typo occurred by Polco when preparing the online version of the survey. This ultimately resulted in 81 submitted surveys left in question on how we want to use the data specific to question 13.
The open survey went live May 3rd. The open survey is meant to be completed by property owners who did not receive a unique mailing to their property. Staff has conducted an advertisement campaign encouraging participation through social media, city events and the Ramsey Resident. Ramsey staff sent an email on May 14th to our City Council along with our advisory boards soliciting them to partake in the survey and to share it with their friends and neighbors. On Saturday, May 18th, staff received feedback that the same error as discussed in point 1 above was present in the Open Survey. This issue was corrected by Polco again on May 21st shortly after staff pointed it out to him. I do not know how many open surveys were submitted with that error, but as of Saturday, May 18th, 27 responses were received for the open survey.
As of Saturday, May 18th, a total of 321 random sample surveys and 27 open survey responses had been collected for a total of 428 total responses. With the error that occurred, at least 108 responses or just over 25% individuals submitted their survey with the incorrect rating headline to question 13. Following the first recognized error in April, Polco staff shared the following options on how to handle the data. In April, there were a different number of responses to each line item within the grid of question 13, but it ranged from one to four responses for the incorrect option. Staff has requested further discussion on the errors that have occurred with Polco to determine their recommendation. At the time of packet preparation, that conversations had not occurred and staff will address the discussion at the work session.
1. Scrub all responses to that particular question prior to the fix such that there are no responses to that question from someone who saw the incorrect column headers.
2. Scrub only those who chose the final option, which was supposed to be "Strongly oppose" but was instead "Strongly support" a second time.
3. Delete the question altogether.
4. Leave it as-is
Depending on the direction provided on how to utilize this data, a footnote to the report will include an explanation of what happened.
The open survey went live May 3rd. The open survey is meant to be completed by property owners who did not receive a unique mailing to their property. Staff has conducted an advertisement campaign encouraging participation through social media, city events and the Ramsey Resident. Ramsey staff sent an email on May 14th to our City Council along with our advisory boards soliciting them to partake in the survey and to share it with their friends and neighbors. On Saturday, May 18th, staff received feedback that the same error as discussed in point 1 above was present in the Open Survey. This issue was corrected by Polco again on May 21st shortly after staff pointed it out to him. I do not know how many open surveys were submitted with that error, but as of Saturday, May 18th, 27 responses were received for the open survey.
As of Saturday, May 18th, a total of 321 random sample surveys and 27 open survey responses had been collected for a total of 428 total responses. With the error that occurred, at least 108 responses or just over 25% individuals submitted their survey with the incorrect rating headline to question 13. Following the first recognized error in April, Polco staff shared the following options on how to handle the data. In April, there were a different number of responses to each line item within the grid of question 13, but it ranged from one to four responses for the incorrect option. Staff has requested further discussion on the errors that have occurred with Polco to determine their recommendation. At the time of packet preparation, that conversations had not occurred and staff will address the discussion at the work session.
1. Scrub all responses to that particular question prior to the fix such that there are no responses to that question from someone who saw the incorrect column headers.
2. Scrub only those who chose the final option, which was supposed to be "Strongly oppose" but was instead "Strongly support" a second time.
3. Delete the question altogether.
4. Leave it as-is
Depending on the direction provided on how to utilize this data, a footnote to the report will include an explanation of what happened.
Timeframe:
15 minutes
Funding Source:
Responsible Party(ies):
Brian Hagen, City Administrator
Outcome:
Provide direction on how the data should be utilized for the survey responses that received the incorrect rating headline.
Attachments
Form Review
| Inbox | Reviewed By | Date |
|---|---|---|
| Brian Hagen | Brian Hagen | 05/23/2024 03:18 PM |
- Form Started By:
- Brian Hagen
- Started On:
- 05/23/2024 02:46 PM
- Final Approval Date:
- 05/23/2024