logo
Beta Test Plan for Pilot Locations

Basic Test Plan Outline for Beta Testing at Pilot Locations

1. Introduction

1.1 Revision History

Date

Changes

Editor

12/4/2007

Original

Lance.Roberts

12/11/2007

Added DN items

Lance.Roberts

1.2 Purpose and Scope

The purpose of this document is to outline the Beta Test Effort for BP Release 1.20. Locations, configurations, and timelines are to be addressed.

1.3 List of Reference Documents

Document Title

BP Release 1.20 Functional Specification Rev A.

1-920512 BP Nucleus Operations Rev 1A.pdf

2-920512 BP Nucleus Programming Rev 1A.pdf

003-920512 BP Nuke Onsite Training Rev 1(A).pdf

4-920512 BP Cashier QRef Rev 2A.pdf

007-920512 BP Nuke Startup Worksht Rev 1(A).pdf

8-920512 BP Countertop Reference Rev A.pdf

10-920512 BP Reference Sheets Rev A.pdf

920512 BP Documentation Review form.doc

920910 BP XP Nucleus Installation Rev 1A.pdf

920910 BP XP Nucleus Installation Rev A.pdf

FortiGate-60_QuickStart_Guide_01-30004-0032-20070301.pdf

FortiGate-60_series_Install_Guide_01-30004-0266-20070215.pdf

Fortigate Rule Set as of 072307.pdf

 

2. Beta Test Scope, Strategy, and Timeline

2.1 Beta Test Customers, Environment, and Scope

Define the scope and strategy for testing the system at one or more customers. 

Location

Features

Agreement Signed?

P1 Bradenton

SVB: ######

Creekwood Crossing BP
xxx.xxx.xxxx
Bradenton, FL 34203

xxx.xxx.xxxx,0# Site

xxx.xxx.xxxx..Nuc

  • BOS ( large internal network )
  • Fortigate60
  • X206 Server
  • SP563 IPTs
  • Wayne Ovation with qCAT

Y

P5 Vancleave

SVB: ######

Hood's Feed & Seed
xxx.xxx.xxxx
Van Cleave, MS 39565

xxx.xxx.xxxx..

  • Tokheim 262A
  • Tokheim Premier C with 4x21 DPTs
  • X206 Server
  • SP563 IPT

Y

P7 Cesar Chavez

SVB: ######

1700 Cesar Chavez
Austin, TX

xxx.xxx.xxxx..Site

xxx.xxx.xxxx--Nuc

  • Gilbarco MPD with Single Line CRIND
  • Fortigate60
  • SP742 Server
  • SP565 IPT
  • Close to Wayne Austin Campus

Y

P10 Bowie

SVB: ######

HighBridge BP
xxx.xxx.xxxx
Bowie, MD 20720

xxx.xxx.xxxx-Site

 

  • Wayne Ovation w qVGA
  • Unitec Car Wash Terminal
  • X206 Server
  • 2 SP563 IPTs

Y

P12 Home Oil

Mark

xxx.xxx.xxxx

 

  • Mannatec

Y

P13 Wassau, WI

xxx.xxx.xxxx..NW Petro

 

  • Mannatec

Y

 

2.2 Testing Criteria

2.2.1 Beta Ship Criteria

 

2.2.2 Beta Install and Criteria to Begin Testing

 

2.3 Testing Scope

2.3.1 Features Tested

List or put in table form the functionality to be tested at the beta customer

Feature

Location

Wayne Ovation qCAT

P1 - Bradenton

Wayne Ovation qVGA

P10 - Bowie

Gilbarco

P7 - Cesar Chavez

Gilbarco GSM

P7 - Cesar Chavez

Tokheim

P5 - Hood’s

Tokheim TED

P5 – Hood’s

CWT ( Unitec )

P10 – Bowie

BOS

P1 – Bradenton

Mannatec ( ONLY NEW FEATURE )

P12 – Wassau, WI

P13 – Home Oil, AL

 

2.3.2 Features Not Tested

Specifically state what will NOT be tested, if anything.

Feature

Location

Currently, we have no ‘Discount by Card Type’ location and Verifone has bugs in the V900 preventing use of this feature with Debit. P1-Bradenton will be exercising the feature informally.

N/A

Mannatec Outdoor Sales with Gilbarco

N/A

Mannatec Outdoor Sales with Tokheim

N/A

 

2.3.3 Other Items Evaluated

List any other aspects of the system or product that will be evaluated by the customer, i.e. operator interface, user manual usefulness, etc.

Item

DOCUMENTATION REVIEW

BP Release 1.2 Functional Specifications

 

1-920512 BP Nucleus Operations Rev 1A.pdf .

2-920512 BP Nucleus Programming Rev 1A.pdf

 

003-920512 BP Nuke Onsite Training Rev 1(A).pdf

 

4-920512 BP Cashier QRef Rev 2A.pdf

 

007-920512 BP Nuke Startup Worksht Rev 1(A).pdf

 

8-920512 BP Countertop Reference Rev A.pdf

 

10-920512 BP Reference Sheets Rev A.pdf

 

920512 BP Documentation Review form.doc

 

920910 BP XP Nucleus Installation Rev 1A.pdf

 

920910 BP XP Nucleus Installation Rev A.pdf

 

Fortigate RetroFit SOW v1.08.doc

 

Nucleus Copy CD For Later Instructions

 

 

 

INTEGRATION TESTING / GOLDCOPY SUPPORT CD ( GENERIC )

Testing is ONLY around the GoldCopy Support CD Framework. Can we install the goldcopy on the system in question and get the application loaded and logged on? This is to prevent ASO installation problems on any platform. Testing port config, etc for each image will not be performed. NPS will, however, follow up with PV to ensure the image testing was done and was verified as working as designed.

X3105

GoldCopy testing not performed due to lack of hardware availability

X206-8482

X205-8480

X200-8479

X200-8478

SP741

SP565

SP563

SP562

SP561

INTEGRATION / APPLICATION SUPPORT CD

Testing is geared towards testing the various options an installer will have available to ensure each one functions as designed. Dependencies, such as documentation, should be created and/or reviewed.

Nucleus Software Installation ( Install )

Passed

Nucleus Software Installation ( Upgrade )

Passed

Nucleus Software Installation ( COPY CD FOR LATER )

Passed

Nucleus Software Installation ( COPY CD FOR LATER ) Instructions

Passed

Antivirus Installation

Passed

Gold Copy Updates Installation

Not Tested

 

 

PERIPHERALS

Ensure that various peripherals are handled appropriately by the Nucleus Application. This is not to be confused with a ‘Gold Copy’ test. Just verify that the software supports the listed devices.

Scanner

Passed

Tank Gauge

Passed

BOS

Passed

Money Order?

Not Supported

Lottery

Not supported

Mannatec

Passed

CDU ( Customer Display Unit )

Passed

Network ( TCP/IP )

Passed

Remote Service Management

Passed

MANUAL TESTING

Stress Testing

Not performed

Exception/Error Condition Testing

Not performed

DN Fixes

N/A

Mannatec Card at POS

Passed

Mannatec Card at Dispenser ( Wayne )

Passed

Mannatec Card at Dispenser ( Tokheim )

No location available

Mannatec Card at Dispenser ( Gilbarco )

No location available

 

 

 

 

TRAINING / HANDOFF

These items need to be performed to ensure that the transition to production is planned and supported. This includes getting Helpdesk & Training acclimated to the product or product changes and creating formal or informal documentation this purpose.

Helpdesk/Training Course

Pending

Helpdesk/Training Guide ( Best Practices )

Pending

Architecture Documentation

Pending

Contact Lists

Pending

Support Structure

Pending

Service Structure

Pending

Tech Tips / Knowledge Base

Pending

 

2.3.4 Safety-related Testing ( if applicable )

Feature

Location

N/A

N/A

 

3. Test Descriptions

For each major set of tests to be run (such as major functional groups, and performance, stress) describe the types of tests to be run. 

3.1 Functional Tests

Verification that the system meets it's functional/feature requirements

Feature

Location

Mannatec Sales – Indoors

P12 – Home Oil, AL

P13 – Wassau, WI

Mannatec Sales – Outdoors Wayne

P12 – Home Oil, AL

P13 – Wassau, WI

 

 

3.2 Configuration Tests

Testing to assure that all functions work under all combinations (hardware configurations, device assignment combinations, etc.)

Feature

Location

Wayne Ovation with qCAT

P1 – Bradenton

Wayne Ovation with qVGA

P10 - Bowie

Wayne w Mannatec

P12 – Home Oil, AL

P13 – Wassau, WI

Gilbarco w Mannatec

NOT PLANNED

Tokheim w Mannatec

NOT PLANNED

Outdoor CWT

P10 - Bowie

Gilbarco w/out Mannatec

P7 – Austin

Tokheim w/out Mannatec

P5 - Hoods

 

3.3 Load and Peformance Tests

Testing to confirm that performance objectives are satisfied. Includes accuracy testing.

 

3.4 Stress Tests

Testing which attempts to break the system by stressing all of its resources.

Feature

Location

Wayne qCAT Stress Tests

P1 - Bradenton

Wayne qVGA Stress Tests

P10 - Bowie

Gilbarco Error Conditions

P1 – Bradenton

Tokheim Error Conditions

P5 – Hoods

POS Mannatec Error Conditions

P12 – Home Oil, AL

P13 – Wassau, WI

 

3.5 Recovery and Error Handling Tests

Testing to confirm that the system recovers from hardware and/or software malfunctions without losing data or control, or that it follows the error handling requirements defined for the product.

Feature

Location

Wayne qCAT Error Conditions

P1 - Bradenton

Wayne qVGA Error Conditions

P10 - Bowie

Gilbarco Error Conditions

P1 – Bradenton

Tokheim Error Conditions

P5 – Hoods

POS Mannatec Error Conditions

P12 – Home Oil, AL

P13 – Wassau, WI

 

3.6 Specific Safety-Related Tests

4. Tools and Test Equipment Required

 

 

5. Roles and Responsibilities

Identify all personnel to be involved directly in the testing, or in critical supporting roles. Define the responsibilities assigned to each.  

Who

Co.

Role

Responsibility

Contact #

Back-up contact

Machelle

 

Wayne

Project Manager

Manager Overall project

 

N/A

 

Lance

Wayne

NPS Tech

Liason between Wayne and Beta Site.

Provide direct support for site issues

512..

BJ

BJ

Wayne

NPS Tech

Backup Tech

512..

N/A

Stephen

 

Wayne

Project Lead  Engineer

Engineering Resource, DN investigation & fixes

512..

 

Liu

 

Wayne

Project Engineer

Engineering Resource, DN investigation & fixes

512..

 

Tim

 

Wayne

Product Validation Manager

Directs testing efforts

512..

N/A

Thomas

 

Wayne

PV Tech

Day Shift

Directs and Performs test effort for additionally releases during beta

512..

N/A

Nelson

Wayne

PV Tech

Night Shift

Directs and Performs test effort for additionally releases during beta

512..

N/A

 

6. Problems/Issues Encountered During Beta

6.1 DNs

Id

Title

O/C

Resolution

Severity

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

C

Cannot Duplicate

Moderate

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

C

Invalid DN

Mild

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

C

Fixed & Verified

Requirement

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

C

Duplicate DN

Serious

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

C

Fixed & Verified

Moderate

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

C

Cannot Duplicate

Serious

 

6.2 Help Desk Issues

ID

Description

Work Around

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

IPT Reset (no need to reboot server or entire site).

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

Pause off IPT

Rebooting IPT

Reset V900

Rebooting Nucleus.

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

Reboot the v900. 

Rebooting Nucleus doesn’t do anything – the problem is inside the EPS box.

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

Network needs to send the Debit Y/N prompt that sends back [Credit/Debit], instead of [Y,N]

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

This is assignable in Application|Station. There are 2 depts: One for Activation, One for Recharge. Be sure to set the appropriate Department HPC to:

532-Purchase

533-Activation

#####

xxxx: xxxx xx xxxxxx xxxxxx xx x xxxx   xxxxxx

Delete all products from the Car Wash Department

May need to delete combo and re-program

 

7. Exit Procedures

  1. Update Site info Oracle and remove them from Beta
  2. Upgrade Beta Sites with Production Code & ensure all is well
  3. Update Beta Sites with new support structure
  4. Handoff Meetings with HelpDesk

 

 

©2013 SiloSix.com All Rights Reserved