The overall picture of WebAzma services is presented in the figure below. Here's a brief description of each one:
- Initial Monitoring: One of the activities that can be done in the lab is to monitor the products and services under evaluation in order to identify the status quo. This identification can be done at different levels. This identification can be done at different levels. For example, you can only extract the list of active services in this area and collect basic information such as the Alexa Rank, the service scope. Or it can be done at a more advanced level. In this case, a basic questionnaire should be designed and prepared for the initial monitoring of these services and, using human assessments, assess and monitor these products and their quality of service.
- Assessing the effectiveness of services based on functional requirements: Functional components represent the capabilities of each service or product in delivering expected and effective outcomes for audiences that are important in attracting and retaining them. These indicators show how effective a product or service is. Since different services have completely different functions, evaluation of the functional indicators of each service or product varies depending on its performance and is measured by its own criteria. In this regard, the lab activities, in addition to provide the test datasets and the benchmark for evaluation, require that appropriate procedures and processes be tested for each designated service and be prepared for the implementation of these procedures and processes. In most cases, automated and human assessment platforms should be developed to provide a more accurate and comprehensive evaluation. The human assessments required in Web Azma are carried out through CrowdSourcing, and in this respect, the development of new tools is not required. But for each service, the related activities in that service should be defined in the context of the CrowdSourcing Framework, and these activities will vary between different services.
- Assessing the effectiveness of services based on non-functional requirements: One of the important aspects of evaluating products and services is determining the extent to which non-functional requirements are met, which in fact represents the performance of one product or service. All web service providers should have a special focus on issues such as speed of responsiveness, availability, usability, security, and so on for better and more suitable service. These indicators are almost the same for all services provided on the web, but their measurement methods may vary from service to service. In this regard, one of the important sections in the laboratory is the evaluation of these categories of indicators (such as applicability, scalability, accessibility, interoperability, number of simultaneous users, response time, reliability and security).
- User tastes: By using logs of a service or putting developed script on the site, it will be possible to analyze the logs and provide statistical analysis and data mining on it. The main purpose of these analyzes is to identify the behavior and tastes of the users who use the service. In this way, the service provider can attract more and more customers by focusing more on what is more pleasing to the users. The analytics tools used in this section are also the same for all web services, but using them for a specific service requires customization.
- Ranking Services: With the formation of different service evaluation tools, one can base their assessment of different aspects on the ranking of services in each area. For example, in order to evaluate each native service, various factors such as the quality of the results, the quality of service, the visit statistics, etc. can be used. In order to score and rank the services in proportion to the importance of each of the indicators in the maturity of a service, an specific weight is assigned to that indicator, and, finally, the native service scores of each area are calculated in accordance with the formula and ranked according to the calculated score. Of course, it's possible to rate the services according to various parameters, in other words, they will be able to rank each and every level of service in each field. In this section, you can compare the distinction and the strengths and weaknesses of the products. In other words, the lab examines the products and services from different perspectives and determines which products in each area or land are ranked higher.
- Market and customer analysis: Another analysis conducted in the laboratory is market and customer analysis. To this end, we use the empirical data (which can be obtained from service logs or other resources) to market analysis and its customers. Examples such as determining the market share of services, visiting statistics, the number and percentage of domestic and foreign users, the geographical distribution of users, the number of unique users and their durability, etc. are included in this section of the analysis.
- Integration: One of the most important activities is the integration of the platforms for evaluating data, products and services, which is one of the main missions of the laboratory. In order to integrate these frameworks, it is necessary to identify the ways of sharing and differentiating these frameworks and, as much as possible, use the core cells created in the laboratory and develop the framework on it according to the requirements for evaluating each product and service.