49 karma · joined January 16, 2023
If you wanted to test it from Ireland, let me know and we will add support for it.
On the roadmap, we have a task to base the number on the end-user location (based on the dialling code of their phone number), which will also allow us to vary the sending times based on their location. Currently, the survey will deliver based on the HQ location time.
On response rates, it's around 20% more responses via SMS than email or chat apps. This is the same for marketing delivered via SMS - the percentage is lower but compared to email, etc. it's relatively high.
In terms of the data quality - we think it's because SMS is not a "company owned" platform that could keep logs, etc. Maybe it feels safer for the end user so they're more honest.
Also, the interaction is fast and fun. We get responses initially via emoji and within the text comment you can hashtag and mention other staff. We're working on MMS support so people can send photos too. It's not globally supported but it works in the US at the moment.
Signals can have an impact if it's run executive level to all staff. It gives people a voice who can see inefficiency but don't have a forum to talk about it, and move past layers that are trying to preserve their roles / status.
While many managers won't do it, usually it's an innocuous thing like being able to move employees between teams and see where data moves that give things away. Not saying that's what's happening in OfficeVibe at all, but it's a common fault.
Writing styles and people exposing themselves is definitely an issue. One commenter here had a great idea on rephrasing through ChatGPT or similar to mitigate that issue.
The decision for us to house the whole interaction within SMS was also a response to links in SMS getting much sketchier to click. Emoji responses are more expensive to run, but they're smoother to work with and more useful for team feedback.
I've been part of teams and seen exit interview data reviewed openly with names, supposedly anonymous feedback twisted to unmask people and D&I surveys where really personal information has been shared in areas it shouldn't be. But that's just where I've been. I think part of what we're doing is a response to that.
The bigger part of it is rapid, in-the-moment responses to issues impacting the team, clients or partner businesses. Because this ideally works weekly, and responses need to be fast and short, it sort of fulfils a different need than a traditional survey. At least, we're seeing different data back with our test group so far anyway.
And yeah, we know the Signals thing might cause some confusion. We're in a different world as a product but it's sure to come up. Funnily enough, when we registered the business we had shortened Signals Intelligence down and Intel's lawyers here got in touch within days to ask us about it. Ahaha.
On your last paragraph - we're looking at incentive programs but we don't desperately need them. Over the long test timeframe, we've averaged 60+% each week for responses (40% within the first 60 mins) and one in two leave a comment with it. In all honesty, our current data is skewed by some companies in the system testing with us and not pressing their team to actively participate which has dropped the weekly average by ~10%. We're going to add a disengaged score (people who haven't responded for 3 consecutive weeks) and a super-engaged score (the opposite of that). Our customers have said they're more worried by the disengagement level than the negative sentiment because it means the team don't care at all.
Thanks again, this is some great stuff for us to think on!
Convincing people it's a safe space is one of the biggest challenges for us. It's part of the reason we think SMS is great (it's not a company-owned platform), and we make an effort to describe our process for the staff so they can understand it. But it's definitely something we will need to work hard at.
If the team is 15 people, you get that information in the initial message and you can determine how safe you feel, and how honest you want to be in your return to it. No doubt, it's less safe at 15 people than at 300 people. But we want to let the end user make the decision.
In terms of the employer or staff gaming it - there's two sides to that, what's happening that would cause them to put the effort in to do it? I mean, a pre-paid sim for enough numbers and to spend the time for setup, etc. It's not a small investment. Not discounting that there's a few people in the world that would, but I think that's a fairly extreme edge case. I think we're trying to work a problem that prevents smart people from contributing to a better workplace because of bad managers, politics, career climbers, etc.
Companies with a culture that would allow that kind of behaviour are unlikely buyers for us too. The anonymity raises too much risk for management around bad behaviour being exposed. And once a comment is on the record, there's some level of accountability at an exec level.
The best companies using it talk to the comment themes (always starting with the most pointed and critical comments) and discuss the details around them and how they're going to remediate the issue, or take advantage of the opportunity.
The worst ones ignore the hard comments. This guts the trust the staff have in the exec team (because the staff WILL talk about what they say in it) and the culture of the company is impacted.
The companies who genuinely buy into this, change their workplaces quite a bit over time. From micro things like the wrong coffee in the kitchen, through to how they're being treated by managers, how the team works together or how they create their product or service.
I come from a professional services background and the people closest to the clients had the best answers to their issues. But due to hierarchy, I often didn't get to hear them. This gave me a direct line.
In all the testing we've done; the feedback is generally honest but professional. The more pointed feedback is often a call for help from the team, and the manager needs help/training to improve. For example, in one test, we uncovered a manager forcing their team to work insane hours, on their days off, etc., without any additional pay or time in lieu - IMO, they deserved to be fired but were just given coaching.
For me, there's also our reputation - if we claim we're protecting users and then don't, our product would be over quickly.