The Windows 10 April 2018 update has arrived! Get the new Dell XPS 15, starting at $999.99
05-02-2014 08:23 AM
186 12345 ...
tools
  1. Roman Royter's Avatar
    After using Cortana for a couple of days now, I must say I'm impressed. However, as always, she can do better and here are some examples:

    Region/Language: USA / English
    Exact Phrase Spoken: when is the neighbors coming out?
    Did Cortana parse this correctly: yes
    Expected Results: read out loud the date
    Actual Results: She said The Neighbors come out on May 9th, 2014
    Feedback: So far so good. Then a follow up command:
    Exact Phrase Spoken: put it on my calendar
    Did Cortana parse this correctly: yes
    Expected Results: I added The Neighbors come out on May 9th on your calendar
    Actual Results: Sure, what event is it?
    Feedback: She didn't understand that I'm referring to the previous query. In essence, what she needs to learn is whenever she's asked "when something happens" she needs to be able to put a reminder about it in the calendar.

    Region/Language: USA / English
    Exact Phrase Spoken: what are the show times for Captain America on Saturday
    Did Cortana parse this correctly: yes
    Expected Results: read out loud the times or ask which theater I would like to go to
    Actual Results: Shows bing search
    Feedback: She needs to be able to do a better job than displaying a search, and even be able to set reminders when requested.

    Also, handling different languages, but this goes to speech recognition in general. According to some estimates, 20% of Americans speak 2 and more languages. This means that a lot of people text in language other than English and even use alphabet that isn't Latin. For Cortana to be truly useful, she needs to learn to pronounce and recognize contact names in non-English while still being in English mode. I understand that I can switch to Russian for example, but I don't want to. I use English mainly for a long time now, but I still call my family by their Russian names/nicknames, and I want Cortana to understand me.
    Last edited by Roman Royter; 04-16-2014 at 12:25 PM. Reason: figured out where the reminder history is
    04-16-2014 12:19 PM
  2. anseld1986's Avatar
    Region/Language: USA English
    Exact Phrase Spoken: How did Microsoft stock do today?
    Did Cortana parse this correctly: yes
    Expected Results: Microsoft is currently up thirty cents today at forty dollars and five cents. This is a point-seven-four percent increase.
    Actual Results: "Microsoft is trading up point-seven-four percent today at forty-point-zero-five." and shows the stock ticker from Bing Finance
    Feedback: If you ask after trading has closed, sometimes Cortana will say things like "Microsoft did well today, etc etc etc" - nicely done!
    wp_ss_20140416_0001.jpg

    Region/Language: USA English

    Exact Phrase Spoken: When does Microsoft pay their next dividend?
    Did Cortana parse this correctly: no ("when does Microsoft pay the next dividend") (the second time I asked, it did parse it correctly)
    Expected Results: Microsoft will pay a dividend of 28 cents per share on June 12, 2014 to shareholders of record May 13, 2014.
    Actual Results: Bing Search, linking to websites related to Microsoft Dividends
    Feedback: When you search for stock information, Cortana tells you how the stock did, amount changed, etc - additional stock information like dividends would be useful.
    wp_ss_20140416_0002.jpg
    04-16-2014 12:21 PM
  3. Kaushik Dash's Avatar
    A lot of my queries may be regarded as suggestions

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Whats 2 times 8
    Did Cortana parse this correctly: Yes
    Expected Results: Expected it to say that "2 times 8 is 16"
    Actual Results: Gave me search result "2*8=16"
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Track flight xxx
    Did Cortana parse this correctly: Yes
    Expected Results: Expected to show and tell the status and timings fo the flight
    Actual Results: Simply gave me the flight status and timings of the flight
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Send an email to my father
    Did Cortana parse this correctly: Yes
    Expected Results: Open an editable email to my father
    Actual Results: Bing search results
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Always show distance and directions informations in kilometres
    Did Cortana parse this correctly: Yes
    Expected Results: To acknowledge that it will give responses in kilometres henceforth
    Actual Results: Gave bing search results
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Always give temperature and weather forcasts in celsius.
    Did Cortana parse this correctly: Yes
    Expected Results: To acknowledge that it will give responses in celcius henceforth
    Actual Results: Gave bing search results
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Block any calls and texts from xxx (assume xxx to be someone)
    Did Cortana parse this correctly: Yes
    Expected Results: Block calls and texts from xx
    Actual Results: Bing Search result
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact PhraseS Spoken: Tell me the reminders for tomorrow, are there any reminders for tomorrow, do I have any reminders tomorrow
    Did Cortana parse this correctly: Yes
    Expected Results: Show reminders for the day after
    Actual Results: Bing search results
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Translate how are you hindi
    Did Cortana parse this correctly: Yes
    Expected Results: Translate and speak (atleast translate until the particular language is available for Cortana) to that language
    Actual Results: Bing search results without the translation.
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Send this email to xxx tomorrow at 12 PM, Send a text saying abc to xxx tomorrow at 12 PM
    Did Cortana parse this correctly: Yes
    Expected Results: To acknowledge that it will send an email or text to the person mentioned at the mentioned time with what was said to send
    Actual Results: Bing search result
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Remove any alarms at 5 PM
    Did Cortana parse this correctly: Yes
    Expected Results: To remove the alarm I had set at 5 PM
    Actual Results: Bing search result
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Remind me to return xxx his stuff when I leave my home
    Did Cortana parse this correctly: Yes
    Expected Results: To announce to return the stuff to xxx (read announce, not just show the reminder) as soon as when I leave my home (or atleast when I am a few metres away from my house).
    Actual Results: Showed me the remi when I was nearly a kilometre away from my house, didn't announce what was the reminder, just showed it.
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Call my sister (when I had named my elder sister 'elder sister' and younger sister 'Younger sister')
    Did Cortana parse this correctly: Yes
    Expected Results: To give me the option to choose which sister
    Actual Results: "Alright, name your sister."
    Addition information - It should be able to recognise who is sister if sister is mentioned in the nick name, i.e. "Elder Sister", "Younger Sister" and when I command to call ym sister, it would ask "Which sister? Your elder sister "sister's name in contact list" or your youger sister "younger sister's name in contact list"? Same with "youngest uncle", "maternal grandfather", etc.
    Screenshot:


    Good initiative! I hope you take some suggestions too! ^^ Thanks for your help! Cortana is awesome!
    Despite being Indian, it understands my (slighty manipulated) accent almost perfectly!
    I am extensively testing Cortana, so I will post more soon.
    Last edited by Kaushik Dash; 04-16-2014 at 02:58 PM.
    04-16-2014 12:26 PM
  4. anseld1986's Avatar
    Region/Language: USA English
    Exact Phrase Spoken: "Let's go to the beach house"
    Did Cortana parse this correctly: Yes
    Expected Results: Bring up Here Drive+ with directions to the location saved as "The Beach House" in my notebook.
    Actual Results: "Okay, getting you directions to [proper address]." Shows page saying "Start Driving Directions." Opens Here Drive+ with the beach house properly set as the destination.
    Feedback: Yesterday this wasn't working - today, it consistently worked perfectly. Awesome!!

    Region/Language: USA English
    Exact Phrase Spoken: "Take me to the beach house."
    Did Cortana parse this correctly: yes
    Expected Results: Bring up Here Drive+ with directions to the location saved as "The Beach House" in my notebook.
    Actual Results: Bing web search for "take me to the beach house"
    Feedback: Seems like a nuance of phrasing versus the above (working) query.
    04-16-2014 12:41 PM
  5. OHardy's Avatar
    Region/Language: US English
    Exact Phrase Spoken: Remind me tomorrow to do staff expense reports.
    Did Cortana part this correctly: No
    Expected Results: Add reminder about Staff expense report
    Actual Results: Stuff expense report
    Feedback: I noticed it has an issue recognizing words with an 'F'.
    04-16-2014 01:04 PM
  6. JamesDax's Avatar
    Region/Language: US English
    Exact Phrase Spoken: how about some jazz
    Did Cortana part this correctly: yes
    Expected Results: starts playing jazz genre from Xbox Music
    Actual Results: Did a web search
    Feedback: To be fair when I said "play me some jazz it worked, but would be nice if she recognized different ways of asking the same question.
    04-16-2014 02:50 PM
  7. David Min's Avatar
    Region/Language: USA English
    Exact Phrase Spoken: I am contemplating suicide
    Did Cortana parse this correctly: Yes
    Expected Results: Cortana to give me suicide helpline
    Actual Results: Bing search of the phrase
    Feedback: This is important stuff
    Chemilinski and Kamyla Garcia like this.
    04-16-2014 06:47 PM
  8. theysaycj's Avatar
    Region/Language: English (USA)
    Exact Phrase Spoken: What should I do?
    Did Cortana parse this correctly: yes
    Expected Results: Say an option of what I do
    Actual Results: Bing search
    Feedback: Cortana knows my interests, it would be really cool if when I ask that question she would reply with one of my interests. ex: watch a movie, hang out with your girlfriend. Also, if she knows who my girlfriend is she could say hang out with "girlfriend's name". Thanks!
    04-16-2014 08:03 PM
  9. realwarder's Avatar
    Region/Language: English (USA)
    Exact Phrase Spoken: Will there be a thunderstorm today?
    Did Cortana parse this correctly: yes
    Expected Results: Say yes
    Actual Results: Weather opens and says "No, it doesn't look like it" despite the whole day showing lightening symbols.
    Feedback: Identify thundery days
    04-16-2014 09:24 PM
  10. realwarder's Avatar
    Region/Language: English (USA)
    Exact Phrase Spoken: Show me CNN.COM/Browse to CNN.COM
    Did Cortana parse this correctly: yes
    Expected Results: Open IE with cnn.com
    Actual Results: Bing search
    Feedback: Would be good to open a browser to a website when asked
    04-16-2014 09:30 PM
  11. realwarder's Avatar
    Region/Language: English (USA)
    Exact Phrase Spoken: Who is my wife?
    Did Cortana parse this correctly: yes
    Expected Results: <Wife contact name>
    Actual Results: Bing search
    Feedback: Show contacts for Nicknamed people
    04-16-2014 09:32 PM
  12. mildmanneredjanitor's Avatar
    Region/Language: Uk
    Exact Phrase Spoken: Read me xxx
    Did Cortana parse this correctly: No
    Expected Results: Cortana to read out loud to me the information requested
    Actual Results: Bing searches
    Feedback: The single most important change needed. Cortana needs to be able to serve up information in spoken form. Read me the Times headlines. Read to me about xxx. Read me a poem. Tell me what birthdays are coming up this week. Read me the Obama speech. Read me that webpage (context sensitive). Also, I need my headphones button to activate Cortana so I can have a PRIVATE conversation!
    04-16-2014 09:38 PM
  13. realwarder's Avatar
    Region/Language: English (USA)
    Exact Phrase Spoken: Show me directions to Walmart
    Did Cortana parse this correctly: yes
    Expected Results: directions to walmart
    Actual Results: A list of Walmart, which is good. She then asks "which do I want", from a list like this:

    1. Walmart Superstore, address aaa
    2. Walmart Superstore, address bbb
    3. Walmart Superstore, address ccc

    However the issue then comes next.

    Exact Phrase Spoken: 1 (one - in response to which do I want)
    Did Cortana parse this correctly: yes
    Expected Results: directions to Walmart aaa
    Actual Results: Bing search results for "One"
    Feedback: a numbered list and the question "which do you want" should enable the numbers to be used to select the item.
    04-16-2014 10:17 PM
  14. Reebs Reebs's Avatar
    Region/Language: English (USA)
    Exact Phrase Spoken: Are you on Twitter? or Are you on Facebook? or Are you on social media?
    Did Cortana parse this correctly: yes
    Expected Results: Yes! Wana be friends? or Yes! Wana follow me? Or Yes, I'm on Twitter and Facebook! Follow me?
    Actual Results: Bing search
    Feedback: Should also be smart enough to open its page on Facebook (app or webpage) to follow her or open the Twitter app with her page.... After all, she said she's Facebook friends with Clippy!
    Chemilinski and L Kapoor like this.
    04-16-2014 10:18 PM
  15. riot9's Avatar
    Region/Language: US / English
    Exact Phrase Spoken: Text my wife and ask her how the kids are
    Did Cortana part this correctly: Yes
    Expected Results: A text to my wife that says "how are the kids?"
    Actual Results: A text to my wife that says "And ask her how the kids are"
    Feedback: The reason I expected this to work is "text my wife and tell her it'll be a late night" results in a text to my wife that says "it'll be a late night"

    wp_ss_20140417_0001.jpg
    Roman Royter likes this.
    04-17-2014 01:55 AM
  16. Akash Patel's Avatar
    Region/Language: English(US) living in India/English(US)
    Exact Phrase Spoken: Where am i
    Did Cortana parse this correctly:Yes
    Expected Results: Show me my current location
    Actual Results: Cortana shows me my location correctly
    Feedback: N/a

    Sent from my RM-914_im_india_269 using Tapatalk
    Bahamen likes this.
    04-17-2014 02:02 AM
  17. riot9's Avatar
    Region/Language: US / English
    Exact Phrase Spoken: Remind me to email Dan twenty minutes after I get to work
    Did Cortana part this correctly: Yes
    Expected Results: A reminder to fire roughly twenty minutes after I get to work
    Actual Results: A reminder to email Dan when I get to work
    Feedback: In the case of reminders for when I get to work, it's rare that I want to have a reminder the moment I get there. I need to settle in, get my day planned out. It's also likely that I wouldn't be able to even hear the reminder if it fired while I'm in the car still, or climbing stairs talking to someone.
    Roman Royter likes this.
    04-17-2014 02:15 AM
  18. iyae's Avatar
    Region/Language: US / English
    Exact Phrase Spoken: Call 08xxxxxxxxx
    Did Cortana part this correctly: Yes
    Expected Results: To dial the number I read out
    Actual Results: Asked me to pick a contact to call
    Feedback: This should be straightforward and she failed. It works randomly, the problem seems to be that Cortana adds a period to the end sometimes and that's when it doesn't work
    shloime likes this.
    04-17-2014 03:56 AM
  19. Kaushik Dash's Avatar
    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Turn on/off all alartms
    Did Cortana parse this correctly: Yes
    Expected Results: To turn on/off all alarms.
    Actual Results: Sometimes it asks which alarm to turn on/off, somtimes it gives bing search results
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: end
    Did Cortana parse this correctly: Nope
    Expected Results: To parse end
    Actual Results: And.
    I tried various ways to make it understand end, but it always took it for and.
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: When did the <TV series> name start/end?
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me the dates
    Actual Results: Showed the dates in bing but didn't tell them.
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: When and at what time does <TV series> air
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me the day and time of the show
    Actual Results: Bing search result without any information on the question (just links)
    Screenshot:

    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Where is the nearest theatre playing <movie name>?, Where can I watch <movie name> near me?.
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me where I can watch the said movie (with theatre name and timings) and then ask me if I would like to set the timing in my reminders
    Actual Results: Bing search result with links
    It could be an issue with me being in India but if it doesn't work in USA either, it can be a great feature!
    Screenshot:


    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: When is the next episode of (show name), when does <showname> air next, when is the next <showname> episode
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me the date and time of the next episode of the show name and then ask me if i would like to have a reminder set
    Actual Results: Bing search result without any information on the question (just links)
    Screenshot:


    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: Where am I?
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me my location
    Actual Results: Told my location but when I asked to send it to my father, it opened Here Drive+ for directions
    I wanted it to send my location to my father
    Screenshot:


    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: How will the temperature be tonight? How will the weather be tonight? What will be the temperature tonight?
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me the information of tonight
    Actual Results: Told me the weather of the whole day without any information of night
    Screenshot:


    Region/Language: English, USA. I live in India though
    Exact Phrase Spoken: What are all the tasks for today, do I have anything to do today?
    Did Cortana parse this correctly: Yes
    Expected Results: To tell me my tasks/events/reminders for today
    Actual Results: Bing search.
    Also, I would like to be verbally able to cancel/complete any task by saying words such as cancel/complete/cancel it/complete it/I have completed it
    Screenshot:
    04-17-2014 06:37 AM
  20. Justin Engel's Avatar
    Custom Reminder settings

    Region/Language: USA English
    Exact Phrase Spoken: "When I ask how do I login to work tell me go to domainname.com"
    Did Cortana parse this correctly: No
    Expected Results: Create a custom reminder that is connected to the phrase "How do I login to work?", so when I ask "How do I login to work?" cortana should respond "go to domainname.com".
    Actual Results: It searched the internet, and it doesn't parse dot as a "."
    Feedback:
    • I want to create custom reminders or responses for a given phrase/question. These reminders are not associated to time or place.
    • Another nice feature would be to change a location reminder when it goes off to a snooze time reminder. So when I get to a location it will remind me to do something, but I can hit snooze. It will then remind me in 5 or 10 min, so I have time to get out of my car and in the building.
    04-17-2014 06:44 AM
  21. Reebs Reebs's Avatar
    Region/Language: USA English
    Exact Phrase Spoken: "Call my wife using Skype"
    Did Cortana parse this correctly: Yes
    Expected Results: Same result as "Call wife using Skype" which is open Skype and call my wife
    Actual Results: Doesn't recognize "My Wife" as "Wife". Understand that I want to call someone using Skype and asks me "Who do you want to call"
    Feedback: I nickname my wife with wife. Cortana understands this when making a regular call. It's enough to say call my wife. For calling using Skype, it doesn't work and the alias has to be used as define: wife.
    04-17-2014 08:29 AM
  22. arrow22's Avatar
    Region/Language: US English
    Exact Phrase Spoken: "Cortana, call [contact's first name]"
    Did Cortana parse this correctly: No.
    Expected Results: Upon not finding a correct contact, give the user the option to select manually and ask to correct her prononciation of the name.
    Actual Results: Cortana couldn't figure out the contact, no way to get her to learn the correct pronunciation of the name
    Feedback: Build a mechanism that allows contact name pronunciation to be defined by the user.

    BTW, Cortana does not understand the terms "Fiance/Fianc" the same way it does for girlfriend/boyfriend and wife/husband. I've only got a year to use the term, so it'd be great to be able to get that fixed before then :)
    Chemilinski likes this.
    04-17-2014 10:07 AM
  23. Talderon's Avatar
    [NOTE]Data from this post on up has been compiled and will be sent in.[/NOTE]

    Thanks all! :D
    04-17-2014 12:57 PM
  24. venkatm's Avatar
    Region/Language: US English

    Exact Phrase Spoken:
    1. What is the weather like (Shows weather in Palo Alto)
    2. How about in San Jose (Shows weather in San Jose)
    3. Show that in Celsius (Shows Palo Atlo weather in Celsius)

    Did Cortana parse this correctly: No

    Expected Results: Expected weather in Celsius from the second city.

    Actual Results: Cortana showed the weather of the first city in Celsius.

    Feedback: Cortana remembers the context. But she should be intelligent enough to change the context when necessary (second city in this instance).
    Talderon likes this.
    04-17-2014 01:43 PM
  25. Reebs Reebs's Avatar
    Region/Language: US English
    Exact Phrase Spoken: Text my wife using Skype
    Did Cortana parse this correctly: yes
    Expected Results: ask me about the message and send it via Skype, like she would call her via skype
    Actual Results: prepares to send an SMS to my wife with the content of "Using Skype" :)
    Feedback: Eventually support for outside of SMS has to come to Skype and others, hopefully WhatsApp and Viber. But Skype sets the example :)
    04-17-2014 10:48 PM
186 12345 ...

Similar Threads

  1. Ability to upgrade from non WP8 Update 3 (GDR3) to Windows Phone 8.1 Preview for Developers
    By thelegendarcy in forum Windows Phone 8.1 Preview for Developers
    Replies: 23
    Last Post: 04-25-2014, 11:23 PM
  2. I have to be honest-love Nokia and Windows but considering LG G3
    By BlackZeppelin in forum Other Operating Systems
    Replies: 12
    Last Post: 04-20-2014, 06:18 PM
  3. Nokia offers voluntary redundancy to employees at Indian factor
    By WindowsCentral.com in forum Windows Central News Discussion
    Replies: 0
    Last Post: 04-11-2014, 08:10 AM
  4. Top Windows Phone Games from the WPCentral Team
    By WindowsCentral.com in forum Windows Central News Discussion
    Replies: 0
    Last Post: 04-11-2014, 07:50 AM
  5. How to force LTE and/or 3G only?
    By Nathan Mienie in forum Nokia Lumia 925
    Replies: 2
    Last Post: 04-11-2014, 06:49 AM
LINK TO POST COPIED TO CLIPBOARD