- 448
- 645 162
Software Testing by Daniel Knott
Germany
Приєднався 30 вер 2011
Welcome to my UA-cam channel 👋🏻.
On this channel you will find videos about
➡️ Software Testing
➡️ Mobile Testing
➡️ Software Testing Leadership
➡️ Software Testing Tools
➡️ How to get a Software Testing Job
🚀 Subscribe to my channel: bit.ly/3qPvEm7
🎗️ Become a channel member:
👉 ua-cam.com/channels/XB6zy4Pu9bPVQHvS8XKLUw.htmljoin
🎗️ Or support me on Ko-Fi:
👉 ko-fi.com/danielknott
📖 Have a look at my blog: www.adventuresinqa.com
📚 My e-books:
👉 leanpub.com/Mobileapptesting
👉 leanpub.com/smartwatchapptesting
📚 Paperback Version:
👉 www.amazon.com/dp/B0B2GMLVHY/
👨🏽💻 Mobile Testing Online Course:
👉 A Beginners Guide To Mobile Testing: www.ministryoftesting.com/dojo/courses/beginner-s-guide-to-mobile-testing-daniel-knott
🤝 Connect with me via 🤝
LinkedIn: www.linkedin.com/in/daniel-knott/
Imprint: adventuresinqa.com/imprint/
Daniel Knott
#SoftwareTesting #Testing #MobileTesting
On this channel you will find videos about
➡️ Software Testing
➡️ Mobile Testing
➡️ Software Testing Leadership
➡️ Software Testing Tools
➡️ How to get a Software Testing Job
🚀 Subscribe to my channel: bit.ly/3qPvEm7
🎗️ Become a channel member:
👉 ua-cam.com/channels/XB6zy4Pu9bPVQHvS8XKLUw.htmljoin
🎗️ Or support me on Ko-Fi:
👉 ko-fi.com/danielknott
📖 Have a look at my blog: www.adventuresinqa.com
📚 My e-books:
👉 leanpub.com/Mobileapptesting
👉 leanpub.com/smartwatchapptesting
📚 Paperback Version:
👉 www.amazon.com/dp/B0B2GMLVHY/
👨🏽💻 Mobile Testing Online Course:
👉 A Beginners Guide To Mobile Testing: www.ministryoftesting.com/dojo/courses/beginner-s-guide-to-mobile-testing-daniel-knott
🤝 Connect with me via 🤝
LinkedIn: www.linkedin.com/in/daniel-knott/
Imprint: adventuresinqa.com/imprint/
Daniel Knott
#SoftwareTesting #Testing #MobileTesting
Should a tester be worried about AI?
In today's video, I am talking about a burning question from the software testing community! Should a tester be worried about AI?
If you have seen my videos on my channel, you noticed that I covered some AI topics already. In many videos, I was showing the new AI features entering the market and will change the way we work and test.
Many of you contacted me and asked what they should do next in their career to remain relevant and if they should be worried about AI. My answer is clear on this topic.
Find it out in the video :).
Thanks to PractiTest for being the main sponsor of this video.
PractiTest isn't your average test management platform.
They are on a mission to push the boundaries of what test management can achieve.
PractiTest is an end-to-end test management that truly unifies and orchestrates all testing practices, tools, teams, and tasks onto a single platform.
Its unique core architecture is designed to streamline and simplify processes and enables top-notch test data management capabilities even for the most complex and robust testing environments.
Its superior QA Intelligence provides unmatched, multidimensional reporting and insights empowering business, day-to-day management, and informed decision-making.
👉 www.practitest.com/
🎗️ Become a channel member:
👉 ua-cam.com/channels/XB6zy4Pu9bPVQHvS8XKLUw.htmljoin
📚 My Book
👉 leanpub.com/Mobileapptesting
👉 www.amazon.com/dp/B0B2GMLVHY/
👨🏽💻 Online course
🧑🏼🏫 A Beginners Guide To Mobile Testing: www.ministryoftesting.com/dojo/courses/beginner-s-guide-to-mobile-testing-daniel-knott by Daniel Knott
My equipment:
📸 Hardware:
🔗 Sony ZV-1: www.amazon.de/dp/B088S2CNFC
🔗 Mac mini: www.amazon.de/dp/B0BSHQM2KB
🔗 Microphone: www.amazon.de/dp/B09MJ1N2D9
🔗 LED Ring Light: www.amazon.de/dp/B0BKZRZ9GK
🔗 LED Light: www.amazon.de/dp/B0BZ43HBS8
🔗 LED Light: www.amazon.de/dp/B0BG4BN1TZ
💿 Software:
🔗 Camtasia www.techsmith.com/store/camtasia
#softwaretesting #Testing #AI #GenerativeAI #AIAssitedTesting
If you have seen my videos on my channel, you noticed that I covered some AI topics already. In many videos, I was showing the new AI features entering the market and will change the way we work and test.
Many of you contacted me and asked what they should do next in their career to remain relevant and if they should be worried about AI. My answer is clear on this topic.
Find it out in the video :).
Thanks to PractiTest for being the main sponsor of this video.
PractiTest isn't your average test management platform.
They are on a mission to push the boundaries of what test management can achieve.
PractiTest is an end-to-end test management that truly unifies and orchestrates all testing practices, tools, teams, and tasks onto a single platform.
Its unique core architecture is designed to streamline and simplify processes and enables top-notch test data management capabilities even for the most complex and robust testing environments.
Its superior QA Intelligence provides unmatched, multidimensional reporting and insights empowering business, day-to-day management, and informed decision-making.
👉 www.practitest.com/
🎗️ Become a channel member:
👉 ua-cam.com/channels/XB6zy4Pu9bPVQHvS8XKLUw.htmljoin
📚 My Book
👉 leanpub.com/Mobileapptesting
👉 www.amazon.com/dp/B0B2GMLVHY/
👨🏽💻 Online course
🧑🏼🏫 A Beginners Guide To Mobile Testing: www.ministryoftesting.com/dojo/courses/beginner-s-guide-to-mobile-testing-daniel-knott by Daniel Knott
My equipment:
📸 Hardware:
🔗 Sony ZV-1: www.amazon.de/dp/B088S2CNFC
🔗 Mac mini: www.amazon.de/dp/B0BSHQM2KB
🔗 Microphone: www.amazon.de/dp/B09MJ1N2D9
🔗 LED Ring Light: www.amazon.de/dp/B0BKZRZ9GK
🔗 LED Light: www.amazon.de/dp/B0BZ43HBS8
🔗 LED Light: www.amazon.de/dp/B0BG4BN1TZ
💿 Software:
🔗 Camtasia www.techsmith.com/store/camtasia
#softwaretesting #Testing #AI #GenerativeAI #AIAssitedTesting
Переглядів: 4 773
Відео
Accelerate Test Automation With Testim CoPilot
Переглядів 4,5 тис.21 годину тому
In my latest video, I am talking about the latest product updates from Testim. Testim just launched Copilot, a new way to interact with your Testim test scripts. With the help of AI, you can now create your own custom steps based on JS generated by Testim copilot. Furthermore, you can fix and explain test code. Check out the video, to see Testim Copilot in action. If you haven't seen my previou...
Am I Successful with my Software Testing Content? | Software Testing
Переглядів 4,1 тис.14 днів тому
Am I Successful with my Software Testing Content? | Software Testing
The 3 Steps Mobile Testing Strategy
Переглядів 4,7 тис.21 день тому
The 3 Steps Mobile Testing Strategy
Teams without Software Tester | How can they survive?
Переглядів 3,8 тис.Місяць тому
Teams without Software Tester | How can they survive?
13 Misconceptions About Software Testing
Переглядів 1,7 тис.Місяць тому
13 Misconceptions About Software Testing
Mobile Test Automation Tools for 2024 and beyond
Переглядів 6 тис.Місяць тому
Mobile Test Automation Tools for 2024 and beyond
Worlds First AI for Software Testing
Переглядів 4,4 тис.2 місяці тому
Worlds First AI for Software Testing
AI-Assisted Software Testing | Hands-On
Переглядів 11 тис.2 місяці тому
AI-Assisted Software Testing | Hands-On
5 Things Every CEO Must Know About Testing
Переглядів 3,3 тис.2 місяці тому
5 Things Every CEO Must Know About Testing
10 Bad Reasons Why Companies Don't Hire Testers
Переглядів 3,1 тис.2 місяці тому
10 Bad Reasons Why Companies Don't Hire Testers
From Head of QA to Freelancing - Interview with Leonardo Lanni
Переглядів 3,5 тис.3 місяці тому
From Head of QA to Freelancing - Interview with Leonardo Lanni
CI/CD Systems - Information Software tester must know
Переглядів 5 тис.3 місяці тому
CI/CD Systems - Information Software tester must know
AI Assisted Software Testing - Interview with Mark Winteringham
Переглядів 6 тис.3 місяці тому
AI Assisted Software Testing - Interview with Mark Winteringham
10x Mobile Testing | Mobile Testing Made Easy
Переглядів 4,4 тис.4 місяці тому
10x Mobile Testing | Mobile Testing Made Easy
Software Testing Interview with Lalit - Founder of Tea-time with Testers
Переглядів 5 тис.4 місяці тому
Software Testing Interview with Lalit - Founder of Tea-time with Testers
Machine Learning Locators for Mobile Test Automation | New Testim Release
Переглядів 2,5 тис.5 місяців тому
Machine Learning Locators for Mobile Test Automation | New Testim Release
Test Management Made Easy - Jira App Review
Переглядів 6 тис.5 місяців тому
Test Management Made Easy - Jira App Review
My Year 2023 in Software Testing - Recap and Shoutout
Переглядів 1,4 тис.6 місяців тому
My Year 2023 in Software Testing - Recap and Shoutout
AI Resources That Might Boost Your Testing
Переглядів 2 тис.6 місяців тому
AI Resources That Might Boost Your Testing
What Is Exploratory Testing & Which Tools Can I use for it?
Переглядів 2,8 тис.6 місяців тому
What Is Exploratory Testing & Which Tools Can I use for it?
Let Your Users Drive The Test Automation - Katalon TrueTest
Переглядів 2,5 тис.6 місяців тому
Let Your Users Drive The Test Automation - Katalon TrueTest
I've tried it since on paper it sounds interesting. Created account, created first project and first test/suite whatever and just tried to record simple "Go to this site --> login --> logout". Whole process was slow as hell (browser cried that this tab was frozen) and didn't even recorded my steps correctly. I tried delete everything and create same test case again and it recorded previous stuff correctly, however failed to record final steps. I've run this test case and for my surprise, not only it was super slow (no surprise there), also "headed" window was disconnecting and when it failed final steps it still logged test result as "TEST SUCCESS"... I didn't bother to try anything else. Disappointing as hell. Funny part was the generated welcome email saying "Unmatched speed and reliability"... nice one. I wouldn't even bother to write this comment if it would be some sort of startup of small team/one person in PREPROD stage or whatever, but this is typical corporate "lets make it asap and add 1000 payed things to milk people". Overall don't even bother.
Sorry to read this bad experience :(. I have tried it and for me it was working. Maybe, in case you want to spend more time on this topic, send your feedback over. I think they would like to hear such comments to improve the product.
It’s good but you need a solution that enables this directly within your project management system like Jira. We are already using Generative AI enabled testing platforms like Vansah directly native inside Jira. However the extra features this has is definitely advanced especially the automation testing capabilities. Not sure if we are going to get much from that as mature frameworks like selenium are too advanced for not integrating with
Yes, you are right. The better the AI solution is integrated in your tech stack the better it can be used and perform. Many things will change in the near future on how we build and test software. I am really looking forward to it.
How did you add that TDC connection in mobile scan?
If you have access to TDC (signed up for it), you get access data that you can add to the mobile scan section. It's pretty simple and straight forward. It's also well documented here: documentation.tricentis.com/tosca/2310/en/content/engines_3.0/mobile/mobile_scan_add_mobile_device.htm
How did you add that TCD connection there in mobile scan?
Check this link documentation.tricentis.com/tosca/2310/en/content/engines_3.0/mobile/mobile_scan_add_mobile_device.htm
Definitely not a world first, either. We launched ours about a year ago.
Which one is it?
I am currently trying to come up with a good concept on "how to tests these LLMs and AI tools correctly". Do you have experience with that respectively some good resources you would recommend?
I haven't started the book "Quick Start to Large Language Models" yet, but I heard good things about it. Or check out the courses Open AI posted on Linkedin lately: www.linkedin.com/feed/update/urn:li:activity:7210983695669706753/ I hope it helps :)
Regarding the point „never trust the output“ I recently had an example: I fed the AI with a simple Regex combined with a max field length statement. The AI did manage to miscalculate field lengths..so always check for errors in the output. 1:0 for human testers i guess ;)
Perfect example, thanks for the comment
Can you do a comparison with Vansah Test Management for Jira and other Testing tools? I work for a company that is very sensitive about where the data resides and found most tools apart from Vansah and Tricentis do not support data residency. Most people are not aware about this and usually assume that the app will retain data in the same region as your Jira’s pinned location. We had to stop using Zephyr because it didn’t support data residency. We are about to sign up to Vansah now which is super straight forward and manages Testing really well.
my problem with testing related cards is that it is very easy to create illusion of activity, but those cards do provide any testing related information, what has been tested, how it was tested and so on. So the cards have no other informational value than "management reporting". Ask youself what will happen if there would be one less card on the board, or one more card? What conclusion would you drive from this? Those cards are nothing more than paperwork. The problem is, that the board should facilitate communication between team members, but in reality of many teams the board becomes the place where you proove your work to the manager (sometimes called scrum master). Many managers want paperwork, because that is what gives them sense of control. And so you serve the reporting purpose of your manager instead of serving the value purpose of your customer. We instead started to play around with the idea of adding testers as reviewers to the pull requests. Since we have an integration branch, besides the trunk, testers are "guarding" the integration branch. They decide, through testing if the increment is worth integrating. Create PR, pick your testers, comment in what you want to be pe paid special attention to, let the PR be approved or declined, after the build was tested. Because in the end its all about the delivery of the application to the customer. This way it also forces the developers to create Pull Requests early.
"Average users open +50 apps a day" -> please which is your source?
there you go buildfire.com/app-statistics/
Hi Daniel, Is there any way to resize the live shot ???as in my PC live shot is very large and complete screen is not visible only partial screen is visible
Not sure at the top of my head. Have you checked the docs?
I just want to know that which is a best mobile automation tool. but you explain the difference and summary of multiple tools.
I can’t tell you which is the best. It depends on your app on your tech stack and on your overall tech environment. That’s why I highlighted all the tools that are worth checking out. Then make a plan on how to combine the tools to get the best out of them.
It seems that the code generated is comparing two arrays of strings, but I am not sure if is locating those strings in the web page
Nice catch, another reason why we as software testes need to check and judge the results of every LLM.
😂😂😂😂😂😂😂❤❤😂😂😂❤@@DanielKnott
Why do we need the JavaScript code to write Automation scenarios at all? There is Playwright and Selenium for that.
@@igoremelyanov7302 sure you can use playwright and other tools to do so. Testim is a low code solution. People with less technical skills can write automation code and if possible can extend it with JavaScript code for own checks. Copilot is a nice extension for it to make it even easier
What tool will best suited for Infrastructure testing
I haven’t used any tools for this area yet.
Started from the bottom now you're here!😎 Legend!
Oh thank you for the kind words. Wouldn’t call me a legend 😅, but thanks
Hi Daniel, thank you for the video! Do you have a tutorial on how to connect an emulator, please?
This is super easy to do. For example on Android, download Android studio, install the emulators from the IDE. Then start the emulator and you can use it within maestro. Just follow the instructions here developer.android.com/studio
@@DanielKnott Will give it a go, thank you so much!
Let me know if you face any problems
Thanks, that's a good introduction especially for the last part, how we should treat them.
Thanks for the feedback! Have a great day.
Please make video for creating portfolio of software testing engineer using chatgpt
Hi, I made a video already about this topic, but without the gpt part. Link: Software Testers Show Your Work - Create an Online Portfolio ua-cam.com/video/tq0PGuln8zg/v-deo.html What do you have in mind with ChatGPT and a tester portfolio?
Keysight Eggplant is not on the list?
No. When I created that video it wasn’t on my radar. Is it worth checking?
Thank you for the video. As I understand this tool helps to save time on fulfilling templates and on button clicks. The tool let us say parses text written in natural language and breaks it down to text's smallest parts, however this tool does not 'prognose' more than it is already provided as an input. I mean i.e. it can not make edge cases from the provided requirements, or? I.e. if in requirements there was a link to figma screen, would this tool go there and add more details to test case based on the screen? Obviously 'there should be login - there is login' it does not contain all required info, i.e.: where exactly on the page? Font? Style, etc.
Great question Elena. For now the tool is „just“ checking the requirements written down. However, your comment would be a great next step. The AI is checking the context of the requirements,too.
@@DanielKnott Thank you!
Really informative but would have much better if you would have mentioned which one is open source
well non of them is. So far I don't know any open source AI testing solution.
thanks
Where is link ?
It’s a bit hidden (new YT feature) underneath my channel name you see a text that is the link to the full video.
Wow. What an amazing tip. Not!
Haha you are right. There must be a copy paste error or text got cut off. Need to check 😅
Hi! Thanks for this video! It's incredibly helpful, especially for those who are just beginning their journey. Our QA team has also shared their trends in the newest video
Thank you
Painless really? "tapOn" does not work for me :D
Any error message?
@@DanielKnott No error message. It behaves like it had tapped already on. But nothing happens after tapOn step. I have also tried with coordinates.
@@myilmaz8492 interesting. Which app are you testing? Have you tried with a different app? I never had any issues with it so far.
@@DanielKnott I am testing our app, build with Flutter. I have tried 3 tools so far: 1- Flutter native integration test: I was able to automate a login test quickly 2- Appium: I could not set it up :D 3- Maestro: Set up was very easy. Application is started during the test execution. But the very first "tapOn" does not happen.
@@myilmaz8492 yes Appium is a monster in terms of setup, way too complex. Tools must be easy to use not to worry about setup. I never tried maestro with flutter but I bet you have read all the information here maestro.mobile.dev/platform-support/flutter
So clear and informative
Thank you Cemal. Any thoughts on the topic?
@@DanielKnott each point you mentioned is invaluable I would also add some points if you don't mind :) Myth: AI Can Replace Human Testers Completely. Reality: While AI excels at automating tasks and crafting test cases, it lacks human testers' critical thinking and adaptability. AI struggles with unexpected scenarios and lacks the user intuition for thorough testing. Myth: AI Testing is Perfect. Reality: AI's effectiveness relies on its training data. Biases or incomplete data can lead to missed bugs or flawed tests. AI testing is valuable but not foolproof; it's a tool, not a fix-all solution.
Thanks for adding your points, both are so true. Now we as testers need to advocate for this wrong perception. Hope that companies don’t do the same mistakes like years ago with automation…
Hello, What editor do you use to write the YAML file? Thanks for making this video!
I am using visual studio code. Glad you like the video.
Thanks, Videio is very Informative for me
Glad you liked it
Thanks you for your video, it helped me a lot! Your explanation was really great. I'm currently looking for a tool integrated with JIRA to manage our tests. I checked QAlity's pricing and it says it's free for up to 10 users. Do you know if each JIRA user counts towards the number of QAlity users? For example, on our team there are 11 JIRA users, but only 3 of them will need to use QAlity. Thanks a lot!
Hi, Happy that you like my video. I am not sure about your case. But all the people over at soldevelo (the company behind Quality Plus) are super nice and helpful. Send them a message and they will help you.
@@DanielKnott got it. Thanks a lot again. 😄
How do you change the mindset in a company that doesn't take care of testing? Developers don't want to test anything and only say it is not my job to test or code automation. So, the only tester in the company should test, create all the bugs, and retest a lot of times. Developers and management don't care about security or performance. Real users are the testers, and there are a lot of bugs. Server downtime is very common, but the company said it is the fault of the users using slow hardware and fix the issues restarting the servers. In a team without testers, the developers took care of the testing, created unit testing, and always thought about the best performance code. However, without any QA, all bugs unrelated to the team were assigned to the team without a tester to identify the root cause. They had to fix all. When I was assigned to that team, I had to add evidence to assign the bugs to the correct teams. It's very challenging to be the only QA and change the mindset of the company.
Hi Abigail, thanks for your comment and your experiences. It's unfortunately not a nice one. Sorry to read that you have such a mess in your company. It really makes me kind of mad to know that companies think that way. I really don't understand why some companies don't have a quality mindset. Are they using the product themselves? Maybe they need to learn the hard way... I usually use risk storming to explain the people the risks we have, the current situation and what can happen in case, the customers have to "test". If the customers are unhappy, in the long run they will never come back. This usually has a huge impact to the revenues and reputation of that company. Usually that triggers some thinking in their minds. If this is not the case, it's a hard working environment for testers, if they can't change anything. If nothing changes, I would suggest to move on. Such work environments can have a huge impact on your health. Best, Daniel
cool
😌
Bro is i3 processor is enough for studying software testing
For studying you don’t need a computer. You can start reading books. Or a mobile device to read blogs. If you want to learn automation an i3 cpu is enough for the start
What do you think is the first certification we need to obtain in QA environment
It’s hard to say. Depending on the context I would say. But I am a big fan of the bbst courses. Check them out
Hi, thank you!!!
Glad you like it
Al = the
Do you missed to send more text ?
so helpful thank you
Glad it was helpful!
The reason I liked is bc I like the ‘stay logged in’ option to provide. Isn’t that efficient and time saving. Good pitch , yet users be logged out after , oh , approx 11 minutes of inactivity is unacceptable. Overall, this is a terribly risky operation, and is in violation of Federal Laws which protect the customers information, as well as the low level front line employees PII, as well.
I have hope that is not another AI scam
have made that experience before?
@@DanielKnott Everytime. I request my team search AI based effective tools. We check more than 30 and all was ussles.
Hi Daniel, Do we have any open source testing tools with AI capabilities ?
Hi, unfortunately I don't know of any open source AI tool.
is this an ad?
No it’s not an ad. I showcase a product that has been launched a while ago. Tagged it as paid collaboration in the beginning.
@@DanielKnott c'mon. We know this is an ad ;d
If you wish so, let’s call it an ad.
Nice one! Just sucks that this is built over Appium, so I expect the abstraction tax to be pretty hefty.
You mean once the ai has generated a test and it will be executed using appium on mobile apps?
can you make a comparison between Qualityplus tool vs other jira's test management tools like Test Xray or testrail?
Thanks for your comment. I love your idea. Will put it on my video list.
Hello, I love the t-shirt, where is possible to buy it?
Hi Sandra, I designed this on my own :). If there are more people with interest I can think of adding them to the YT shop. Best, Daniel
@@DanielKnott Awesome! Thanks for the answer!
This is extremely bad advice.
Why do think so? I am also not a big fan of artificial test coverage. But it’s important to raise the topic. To talk about areas in the tech stack with low coverage. Then identify the most important parts of the stack and try to increase the coverage, whatever maximum coverage means. For sure not 100% 😃
Hello Daniel, this is a very, very good and very important video. I hope many managers see it. A good and communicative software tester is an important and valuable backbone and quality conscience in the team and much more than a bug finder or automation test writer. Due to his role, he usually has more knowledge about the overall project and better contacts with team members than the manager. Thank you for communicating this so well. In many years as a QA engineer, I have learned that you first have to explain and prove the value of quality thinking to many managers through your work over a longer period of time. It would be nice if this were much more natural. Many greetings from colleague to colleague, Torsten
Thanks Torsten. Feel free to share the video with your network that many people can see it. I totally agree with you here. Once good testers have been added to teams, managers and other stakeholders see the value in them. However, I also have seen not so good testers in teams and they paint the picture that testing is a „bottleneck“.
No sound?
No, no sound.
Thanks very much for the extremely informative video. I am curious does Google's Testing infrastructure allow for you to expire a build? For example in Testflight on Apple if you but up a build of a beta it expires after 90 days. Is there any way of doing the same thing on the 2nd kind of track? The closed Beta test. We are trying to do a large scale Beta test at the moment but there are concerns about an APK of the beta floating around once the test is finished. Any information about this would be really appreciated. Thanks again!
Hi Stephen, So far this is not possible with Google Play. I would suggest you build your own system inside the app that can be triggered from a backend to inform the user that this beta is outdated and that it needs an update.
Okay that’s not a bad idea actually