Reviewers will review and
rate each application using the following criteria. The relative weights
of each criterion
are identified in parentheses.
1.Project Purpose (20%)
Each
application should describe a clearly defined project that focuses on underserved
communities. In this
criterion, reviewers will judge each application on (1) the overall design
of the project and (2) the degree to
which it provides opportunities for underserved communities.
In
assessing the project design, reviewers will examine the degree to which
the applicant clearly: defines the
problem(s) within the community to be served and describes its severity;
proposes creative and practical
means of addressing the community's problem(s) employing digital network
technologies; and identifies
anticipated outcomes and that are both realistic and measurable. Reviewers
will also assess the degree to
which an applicant convincingly links the three major elements–problem(s),
solution(s), and outcome(s).
Reviewers
will assess the degree to which the project targets underserved communities
and populations, and
the degree to which the proposed project will address the circumstances
and challenges (such as poverty,
low literacy, disabilities, high unemployment, low educational achievement,
high crime rate, poor health
status, etc.) they face.
Return to Top
2.Innovation (20%)
Reviewers
will assess innovation by examining both the technology to be used and
the application of
technology in a particular setting, to serve a particular population, or
to solve a particular problem. TOP
defines innovation broadly. For example, projects that involve imaginative
partnerships, the introduction of
new business processes designed to offer more effective services, untested
strategies for overcoming access
barriers, or new techniques that transform inter-organizational relationships
can all be considered innovative.
TOP encourages applicants to experiment with leading edge technologies.
It is, however, the creativity
behind the application of the technology to meet community needs that ultimately
determines the level of
innovation.
Using
their experience in their respective fields, reviewers will examine each
project in a national context and
evaluate (1) how an application compares with, complements, and improves
on the existing base of
knowledge and project practices and (2) what insight(s) the proposed project
could add to what is known
about using digital network technology as a solution to problems in its
particular field.
Return to Top
3.Diffusion Potential (20%)
The
innovations and approaches to be demonstrated in any proposed project should
contain the potential to
be diffused broadly throughout the country. NTIA expects that each awarded
project will serve as a model
for other communities to follow.
To assess this potential for diffusion, reviewers will consider four factors:
a.the degree to which the problem identified by the applicant is common to many communities;
b.the relative advantage of the project's innovations over established
approaches to addressing the
specified problems;
c.the ease of replication and adaptation, based on considerations such as cost and complexity; and
d.the applicant's plans and budget resources dedicated to disseminate actively
the knowledge gained from
the project's successes and failures.
Return to Top
4.Project Feasibility (15%)
In
assessing the feasibility of each application, reviewers will focus on
six issues: the technical approach, the
qualifications of the project staff, the proposed budget, the implementation
schedule, plans for protecting
privacy, and the applicant's plan for sustaining the project beyond the
grant period.
a.In assessing technical approach, reviewers will examine the degree to
which the proposed system
would work and operate with other systems; technological alternatives that
have been considered;
designs for system maintenance and periodic upgrades; and plans project
expansion. Applicants are
expected to make use of existing infrastructure and commercially available
telecommunications
services, unless extraordinary circumstances require the construction of
new network facilities.
b.In assessing the qualifications of the project team, reviewers will assess
the applicant and its partners to
determine if they have the resources, expertise, and experience necessary
to undertake, evaluate, and
complete the project and disseminate results within the proposed period.
c.Reviewers will analyze the budget in terms of clarity and cost-effectiveness.
The proposed budget
should be appropriate to the tasks proposed and sufficiently detailed so
that reviewers can easily
understand the relationship of items in the budget to the project narrative.
d.Reviewers also will assess the degree to which the implementation process
is comprehensive,
reasonable, and can be completed in the proposed time frame.
e.Reviewers will evaluate the applicant's plans to safeguard the privacy
of the project's end users and
others affected by the project.
f.Finally, reviewers will examine the applicant's strategies to sustain
the project after the completion of
the grant.
Return to Top
5.Community Involvement (15%)
Each
application will be rated on the overall level and breadth of community
involvement in the development
and implementation of the proposed project. Reviewers will:
a.analyze the applicant's partnerships to ensure that they include linkages
among unaffiliated
organizations (from the public, non-profit, or private sectors) as an ongoing
and integral part of project
planning and implementation. TOP considers partners to be organizations
that supply cash or in-kind
resources and/or play an active role in the planning and implementation
of the project;
b.examine the steps the applicant has taken to include and sustain the
involvement of a variety of
community stakeholders. Reviewers will look for evidence of demand, from
the community, the end
users, and the potential beneficiaries, for the services proposed by the
project; and
c.consider the degree of attention paid to the needs, skills, working conditions,
and living environments
of the targeted end users. Reviewers will consider the extent to which
applicants involve representatives
from a broad range of potential users in both the design and implementation
of the project and consider
the varying degrees of abilities of all end users, including individuals
with disabilities. Reviewers will
also assess the degree to which the project addresses barriers which limit
a community's or a group's
access to digital network technologies. Finally, reviewers will assess
the applicant's plans for training
end users and upgrading their skills.
Return to Top
6.Evaluation (10%)
Each
application will be rated on its proposed plans for evaluating the project.
Reviewers will assess the
extent to which the applicant's research or evaluation design: (1) provides
for continuous feedback for
project planning, implementation, review and revision; (2) addresses the
problems, solutions, and anticipated
outcomes described in the project purpose and yields valid and reliable
findings; (3) captures lessons learned
and sufficient descriptive data so that others may easily adapt and replicate
the project; and (4) meets TOP's
requirements for an independent evaluation as described in the "Reporting
Requirements" section of Notice.
Reviewers will examine:
a.the research design and methodology;
b.evaluation questions, data collection, and data analysis plans;
c.the qualifications of any staff or external evaluators working on the evaluation; and
d.the allocation of resources for implementing the evaluation and reporting
project findings.