ArticlePDF Available

Approaches to Automatically Extract Affordances from Patents

Authors:

Abstract and Figures

The importance of affordance in Engineering design is well established. Artifacts that are able to activate spontaneous and immediate users’ reactions are considered the outcome of good design practice. A huge effort has been made by researchers for understanding affordances: yet these efforts have been somewhat elusive. In particular, they have been limited to case studies and experimental studies, usually involving a small subset of affordances. No systematic effort has been carried out to list all known affordance effects. This paper offers preliminary steps for such an ambitious effort. We propose a set of three different approaches of Natural Language Processing techniques to be used to extract meaningful affordance information from the full text of patents: 1) a simple word search, 2) a lexicon of affordances and 3) a rule-based system. The results give in-depth measures of how rare affordances in patents are, and a fine grain analysis of the linguistical construction of affordances. Finally, we show an interesting output of our method, that has detected affordances for disabled people, showing the ability of our system to automatically collect design-relevant knowledge.
Content may be subject to copyright.
Cite this article: Chiarello, F., Cirri, I., Melluso, N., Fantoni, G., Bonaccorsi, A., Pavanello, T. (2019) ‘Approaches to
Automatically Extract Affordances from Patents’, in Proceedings of the 22nd International Conference on Engineering
Design (ICED19), Delft, The Netherlands, 5-8 August 2019. DOI:10.1017/dsi.2019.255
ICED19
INTERNATIONAL CONFERENCE ON ENGINEERING DESIGN, ICED19
5-8 AUGUST 2019, DELFT, THE NETHERLANDS
ICED19
APPROACHES TO AUTOMATICALLY EXTRACT
AFFORDANCES FROM PATENTS
Chiarello, Filippo (1); Cirri, Ilenia (1); Melluso, Nicola (1); Fantoni, Gualtiero (1); Bonaccorsi,
Andrea (1); Pavanello, Tommaso (2)
1: Università di Pisa; 2: Erre Quadro s.r.l.
ABSTRACT
The importance of affordance in Engineering design is well established. Artifacts that are able to activate
spontaneous and immediate users’ reactions are considered the outcome of good design practice.
A huge effort has been made by researchers for understanding affordances: yet these efforts have been
somewhat elusive. In particular, they have been limited to case studies and experimental studies, usually
involving a small subset of affordances. No systematic effort has been carried out to list all known
affordance effects. This paper offers preliminary steps for such an ambitious effort.
We propose a set of three different approaches of Natural Language Processing techniques to be used
to extract meaningful affordance information from the full text of patents: 1) a simple word search, 2) a
lexicon of affordances and 3) a rule-based system.
The results give in-depth measures of how rare affordances in patents are, and a fine grain analysis of
the linguistical construction of affordances. Finally, we show an interesting output of our method, that
has detected affordances for disabled people, showing the ability of our system to automatically collect
design-relevant knowledge.
Keywords: Affordance, Patents Analysis, Design theory, Semantic data processing, Design methods
Contact:
Chiarello, Filippo
Università di Pisa
Italy
filippochiarello.90@gmail.com
2487
ICED19
1 INTRODUCTION
The importance of affordance in Engineering design is well established. Artifacts that are able to
activate spontaneous and immediate users reactions, leading to a smooth and intuitive use of the
object are considered the outcome of good design practice.
For this reason many studies in Cognitive Psychology have addressed the causes and consequences of
affordance and many others in Engineering Design have explored the possibility to improve the design
practice in order to capture the great benefits of user experience behind affordances.
Yet these efforts have been somewhat elusive. In particular, they have been limited to case studies and
experimental studies, usually involving a small subset of affordances. No systematic effort has been
carried out to create a large scale repository, or knowledge base, for all known affordance effects.
This paper offers the preliminary steps for such an ambitious effort.
It advocates the use of patent texts as the main source of information, and of Natural Language
Processing (NLP) techniques to be used to extract meaningful affordance information from the full
text.
After a short review of the literature, the paper critically discusses the state of the art in information
retrieval of affordances (Section 2), showing its serious limitations. It then explores concurrent NLP
approaches (Section 3), discussing their theoretical background, preliminary results and limitations.
Section 4 shows an interesting preliminary finding about affordances for people with disabilities.
Finally section 5 discusses the main conclusion of the work and proposes some further research path.
2 LITERATURE REVIEW
In the present section we present the literature that is relevant to our work. In section 2.1 we show the
works that defined the concept of affordance; in section 2.2 we review the literature related to the
extraction of design concepts from patents.
2.1 Affordance: a concept between Engineering design and Cognitive psychology
The notion of affordance has been extensively studied in Engineering design and Cognitive
psychology, and more recently in Robotics and Artificial intelligence. According to the pioneering
studies of Gibson (1966), when the constant properties of constant objects are perceived (the shape,
size, color, texture, composition, motion, animation, and position relative to other objects), the
observer can go on to detect their affordances.
In addition, the cognitive processes that lead to affordances invite the actor to an action of use of the
object (Gibson 2014). The subsequent literature has elaborated on this notion and in some case has
significantly extended it.
Several authors (Cascini 2011, Gibson et al., 1994, Turvey 1992, Stoffregen 2003) agree with the
common point that an affordance manifests itself in relation to the action and direct perception
capabilities of a particular actor. This means that affordance is a relational concept, requiring the
interaction between different entities, rather than a properties of entities themselves (object or actor).
Two mail lines of extension of the concept can be mentioned. First, while in the original formulation
there was an emphasis on visual perception, some authors (Jamone et al., 2018) wonder why this
should not extended to other sensory perceptions. For example, a computer fan provides auditory
affordance to its user via its noise.
Second, following an early suggestion of Maier and Fadel (2003), Chemero (2003) has proposed an
ecological perspective on affordance. He claims that affordances refer to the relation between the actor
and the overall environment that interact with an object, not only with the individual object. In this
contextual perspective, the proposition that describes the affordance relation between two entities of
the type The apple affords to be eaten by the pig has the same structure than the proposition John
is taller than Mary.
Another group of researchers gives an interesting point of view on affordances (Maier and Fadel,
2003, Brown and Blessing, 2005, Gero and Kannengiesser, 2004, Kannengiesser and Gero, 2012).
Following these contributions in Engineering Design theory, affordances can be seen as cognitive
shortcuts, or fast cognitive processes that reduce the burden of reasoning. By these shortcuts the
2488
ICED19
user skips the entire reasoning about the causality chain and links directly the behavior with the
structural feature of the object (Spreafico et al., 2015).
The concept of cognitive shortcut shifts the affordances focus to the perspective of the user, who
needs to perceive the features in the most disambiguous way. When a user is exposed to a certain
number of the same events, manipulating homogeneous classes of objects, he or she immediately
associates the structure of the object (or part of it) with its possible behaviours. However the
affordance problem is designing common products in a way that they are accessible and easily usable
by as many people as possible. The inclusiveness is an important challenge for everyday objects
designing, but nowadays it is limited to specific cases of study and groups of users (such as Dong and
Vanns 2009, Langdon et al., 2015 and Goodman-Deane et al., 2016).
While there is significant theoretical development on the concept of affordance, with significant
agreement between studies in Cognitive psychology and in Engineering design, there is still a lot to be
done to make the concept global and operational. In particular, what is needed is an effort to build up a
repository, or a structured list of affordances, to be used for information search and retrieval, on the
one hand, and for methods of creativity and conceptual design, on the other hand. In turn, this would
require to identify the sources of information for such a large scale effort.
2.2 Extracting design relevant information from patents texts
While there is significant agreement on the concept of affordance and on its importance, there is little
work on how to make it usable for pragmatic purposes. The starting point should be to ask about the
sources of information needed to identify affordances.
We suggest that a promising source is the full text of patents. Patents cover approximately 80% of all
technical information available. They are by nature publicly available and an impressive literature has
been developed in the last few years to extract information from the text of patents, aimed at a variety
of audiences, from readers interested in Strategic management and Technology management (Holger
2003) to marketers and designers (Chiarello 2017). In this paper we focus on information aimed at
supporting the design process, from the conceptual stage down to industrial development. In this
process affordance-related information would be of great value.
At the same time, it must be recognized that there are still large difficulties in extracting information
from patents, in particular in identifying and extracting design related information. The main reason is
that this information (e.g. the user of the invention, the advantages of the design solution described in
the patent or the drawbacks of the state of the art of a class of products) are hidden in patents
documents (Chiarello 2018). With the word hidden we mean that design related information in patents
are:
Rare: only few patent applicants insert this information in the patent application, since it is not
mandatory for legal reasons.
Fuzzy: even if an applicant insert design related information, the linguistic form in which this
information is written is complex and obscure, since applicants try to make it hard for other
designers or inventors to find the patent or to design around it.
This means that in order to extract valid information, dedicated analytical techniques must be designed
and implemented. It is well known how Genrich Saulovich Altshuller for the development of TRIZ
identified several design rules by manually inspecting thousands patents, in a fully bottom-up
approach (Savransky 200). Luckily enough, impressive advancements in computational linguistics in
the last two decades made it possible to carry out analysis on the full content of large collections of
patent texts. It is clear that text mining analysis of patents can be a game changing source of
information for designers (Boyack et al., 2013).
3 APPROACHES TO FIND AFFORDANCES IN PATENTS
In this section we explore three different approaches to find affordances in patents. We start with the
simple case of a word search in 3.1, then in section 3.2 we study the development of a lexicon of
affordances and finally in section 3.3 we create a rule-bases sentence extractor able to extract
sentences containing affordances.
2489
ICED19
3.1 A text-search approach
A first naïve approach to find affordances in patents is to search for the word affordance (and its
lexical variations). The results of this search would also give us a preliminary metric of how hard is
find affordances in patents. To do that we have to compare the volume of this search with another one
and see if there are differences between patent classes. For this reason, table 1 shows the distribution
of the term affordance and user within the International Patent Classification (the first 15 results in
decreasing order of occurrence for the word affordance).
It is interesting to observe that, within the first 15 sub-classes, the class G06 (Computing; Calculating;
Counting) occurs four times and the section G (Physics) ten times.
Furthermore, from these data it is possible to make the following observations:
the term affordance appears very rarely, less than one in thousand cases
it is not equally distributed across patent classes
the presence of the term is concentrated in just one IPC class, which largely contains
technological devices.
In comparison, searching for user shows that this term is significantly more used than affordance (on
average, from 10% to 40% of patents). Accordingly it is possible to conclude that affordance-related
terms are rarely used in patents in the explicit form. This makes the search for affordance-related
words more difficult- but perhaps more rewarding if successful.
Table 1. Subset of affordanceand userdistribution over the IPC sub-classes
Class Name
IPC
All
patents
Patents
including
affordances
% patents
including
affordances
Electric digital data
processing
G06F
4,850,637
2,797
0.0005
Transmission of digital
Information
H04L
2,495,628
532
0.0002
Data processing systems
or methods
G06Q
1,104,958
472
0.0004
Pictorial communication
H04N
2,742,473
387
0.0001
Image data processing
G06T
844,257
310
0.0003
Telephonic
communication
H04M
990,667
202
0.0002
Arrangements or circuits
for control
G09G
634,288
197
0.0003
Wireless communications
Networks
H04W
1,404,091
197
0.0001
Recognition of data
G06K
991,586
194
0.0001
Speech analysis or
synthesis
G10L
260,878
137
0.0005
Measuring distances,
levels or Bearings
G01C
430,077
90
0.0002
Information storage based
G11B
1,418,776
79
0.0001
Card, board, or roulette
games
A63F
550,182
72
0.0001
Computer systems based
on specific computational
models
G06N
96,705
70
0.0007
Signalling or calling
systems
G08B
455,249
68
0.0001
2490
ICED19
Analysing the problem more in detail, figure 1 shows that, while the absolute occurrence of user-
related and affordance-related words differs by several orders of magnitude, the two classes of words
are correlated.
Patent sub-classes located in the green region refer to Transmission of digital communication and Data
processing. They exhibit a larger occurrence of user-related words, perhaps as a consequence of the
intense use of the word user in the technical language of Information technology. Another
interesting part of the figure is the purple region. It shows that there are not patent sub-classes in
which affordance-related terms are used without the user-related ones. In the blue region, it is
reasonable to see the class Speech analysis or synthesis, where the uncanny valley (Mori, 1970) of bad
designed affordances can deeply affect the usability of such systems. We can thus summarise that the
behaviour of the term affordance is anomalous de facto since it is explicit in classes more related to
communication and information than in classes related to standard artefacts. Such patents contain
attempts to recreate the affordance of an object in the virtual world, replicate a number of
affordances (of paper) that cannot be easily replaced with existing digital media (G06K), improve the
UI via an intuitive user interface affordance (G06T), with a control affordances widget
containing a set of control buttons (G06N), a GUI affordance (such as a scroll bar) with which the
off-screen objects are to moved into view (G09G).
Probably (see next paragraphs) the affordances in cases of artefacts are more explicit and the
affordance is described more with his -ability than with the term affordance itself.
Figure 1. Correlation between the percentages of occurrence of user-related and
affordance-related words across patent sub-classes
2491
ICED19
3.2 Developing a lexicon of affordances: the Ility approach
Several authors (Maier and Fadel, 2003, Kannengiesser and Gero, 2012, Spreafico et al., 2015,
Jamone et al., 2018) uses the suffix -ability in order to indicate affordances. For example the stairs
afford climbability while the chairs afford sittability. In the present section we study the implications
of using this lexical construction to automatically extract affordances from patents.
First of all, we have to consider the fact that the collection of words ending with ability can lead to
extract false positives: collecting all the English words ending in ability is not a suitable strategy. For
example stability is in between a property and an affordance, but only the context helps to discriminate
between the two. Probability, disability, viability and many others certainly do not indicate an
affordance.
In order to eliminate this problem we carried out an extensive domain knowledge-based analysis of
correctly expressed affordances ending with -ability suffix. This analysis leads to the following
restriction: a word ending with the suffix ability is an affordance if and only if it includes a functional
verb. For example storability is an affordance because to store is a functional verb.
The theoretical rationale for this suggestion comes from the idea that affordances were functions in the
past, but have become affordances due to repeated use. The user immediately connects the implicit
function to one or more product features, without reflecting on the abstract function implied by the
use. In order to reconstruct the origins of the affordance we should start from a careful consideration
of those verbs that are implicit in words ending with ability and select only those with a functional
content. As we will see, this process can be automatized to a large extent.
At the same time the collection of words ending with ability can lead to false negative too. In fact it
ignores those expression with functional verbs + ability than cannot be properly expressed in the
English language. Many functional verbs simply do not have an English word that transform them into
an ability word. Anyway, the constructs ability to, able to, capability of, capable of, easy to plus
functional verbs are in part used to solve some of these language problems. Therefore affordances are
more than the -ability ending words and an extensive and detailed study about their presence in patents
can not ignore such constructs.
Summing up, the candidate collection of words denoting affordances is formed by the subset of words
ending in ability in which the verb is functional, plus those expressions in which functional verbs
appear after supporting expressions that denote a capability.
It should be noted that this collection may still include ambiguities. In some cases we can have
affordances in the verb + ability structure even if the verb is not strictly functional verbs, at least in the
rigorous definition of Stone and Wood (2000) and Pahl and Beitz (2013). For example, to climb or to
sit are not functional verbs, but rather denote the intention of the user. Hence climbability and
sittability should not be considered affordances stricto sensu. Yet we should pay attention to the
possibility that the natural language of users includes these verbs as truly functional, by attributing the
intention to the object.
For these reasons, the functional affordances lexicon have been built by adding the suffix ability to the
stem (the lexical root of the word) of functional verbs using the list of verbs disclosed by Bonaccorsi
and Fantoni, (2007). Then it has been expanded using a list of -ility ending terms obtained from
WordNet
1
. Finally, through Boolean operation the terms contained within the former group have been
filtered out from the latter. At this point an algorithm is applied to the resulting group in order to
separate words with verbal roots from words without any verbal root and tagged as properties (similar
to the concept of performance (De Benetti et al., 2017)).
The developed lexicon contains 38 functional affordances (e.g.
acceptability, adaptability, alterability
)
and 154 non-functional affordances (e.g.
accessibility, accountability, admirability)
. It was also possible
to collect a list of 123 properties ending in ility (e.g. ability, agility, amability) giving a clear answer
to the problem of identifying false positives in the collection of words ending with ability.
3.3 Rules to find sentences containing affordances
The goal of this section is to detect the lexical constructions that are able to identify sentences
containing affordances in a given text. This approach helps to detect those affordances that are not
1
Wordnet.com
2492
ICED19
explicitly expressed neither by the word affordance, or the construct verb+ility, respectively explored
in sections 3.1 and 3.2.
After reading a sample of patents, a set of rules is deductively outlined and an algorithm of text mining is
implemented to detect the sentences that match these rules. These rules are shown in second column of
Table 2, while the first column shows a sample of sentences containing affordances extracted using the
relative rules. The sentences where extracted from a random sample of 10,000 patents collected from the
freepatent
2
database. From the entire set, only 398 sentences contained one or more of the rules.
Many of the automatically selected sentences begin with pronouns which relates to the previous part
of the patent. In these cases the rules are observed even if the features are not explicitly present in the
sentence. For example, the sentence Due to this, the user can easily recognize the used portion of the
tool (4) is related to the immediately previous sentence in the patent The used portion (image 122)
and the unused portion (image 123) are displayed by mutually different display modes (for example
different colors).
Furthermore, looking at the sentence The color makes easy to identify the grasping position
suggests the abstraction of some semantic considerations. Indeed, in this sentence the feature (color)
that promotes the affordance has an impact on one of the five senses. In addition, there is a construct
easy to that indicates a design action and there is a verb indicating a function or a learning and
cognitive action. All of these abstractions suggest the deployment of a knowledge-based detection
system as further future effort.
Table 2. Sentences automatically detected with high likelihood of containing affordance
Sentence
Rule
The user can easily navigate a set of visual
representations of the earlier views
The term user followed by the modal verb can
and adverbs such as readily, efficiently, quickly
and easily
Displaying the individual stats in a similar
manner makes it easier for the user to
read/interpret the group
The verb make followed by the comparative
adjective easier and for user to
The map view can include a map filter which
allows the user to quickly sort through providers
on a geographical scale
The verb allow to followed by user and adverbs
such as readily, efficiently, quickly and easily
By representing documents as numbers, a user
can easily use a simple keypad to indicate the
document that he wants to print
The term user followed by can and adverbs such
as readily efficiently, quickly and easily
Superficial burns are easy to clinically diagnose
by eye and to treat with salves and dressings
Forms of the verb to be combined with easy to
A user may proactively identify himself or herself
by entering self-identification information via a
user interface of the user device
The term user followed by the modal verb may
and a verb which indicates the human ability to
detect something
The interface enables a user to more easily view
recent notes and emails associated with a
particular client
The verb enable to combined with user and
adverbs such as readily, efficiently, quickly and
easily
4 A VALUABLE PRELIMINARY RESULT: AFFORDANCES FOR DISABLED
PEOPLE
If the affordances of an artifact are the set of all potential human behavioral interactions that the
artifact itself may allow, disability implies that only a subset of possible interactions are permitted,
with respect to the average user.
2
Freepatents.com
2493
ICED19
It is possible to suppose that human senses functioning is similar to a process, in which each element
of a sensory organ performs a biological function. If the sense does not work (e.g. a blind person) or
works wrongly (e.g. a color-blind person), the whole or part of the sensory process will be
compromised. In some cases correcting the sense process malfunction is impossible or too expensive
(at least nowadays). How can affordances help a person with a non-functioning sense?
Human beings normally perceive things throughout the five senses. However, when a sense doesnt
work (correclty or at all), the perception continues to be made using remaning senses. Therefore
disabled people transfer the perception of things from a non-functioning sense to a functioning one.
Sensory sobstitution is acknowledged in patent literature: new additional features are designed in
inventions intended to disbaled people. Examples of such additional features (e.g. for visual or hearing
impaired people) can be especially found in patents. Considering the sight process malfunctions, it is
possible to find tactile and auditive solutions which makes disable people see via ears that can be
considered as eyes.
Within the group of visual impaired people, there are also the color-blind ones, that could be enabled to
see colors using particular combinations of different forms and lights. An example can be found in the
following patent example (see Figure 2) extracted using the rules shown in section 3.3 : The bar shape
can be formed by either covering portions of a conventional incandescent traffic light or LED traffic
light, or the LEDs can be arranged in two or three rows to form the horizontal bar. Because the bar is
illuminated red, ordinary drivers are able to distinguish the color and stop. Because the light forms a
horizontal bar, color blind drivers are able to easily determine that the light is signaling a stop.
Figure 2. Traffic control system, United States Patent 8154423
In this example it is possible to see a specific affordance for color-blind people. However, considering
the hearing malfunctions, it is not possible to reach similar conclusions. Searching in the full text of
patents it is not possible to find explicit expressions of affordances for hearing impaired people with
respect to sample that we analyzed in the present paper. It seems that the distribution of affordances
across the five senses is not uniform, so that some senses prevail over others. Probably if humans had
perceived the world throughout hearing like bats, in patents there would be a different distribution of
affordances for hearing impaired people.
5 CONCLUSION AND FUTURE DEVELOPMENTS
The paper offers a preliminary discussion of a new methodology to extract affordance-related
expressions from technical document in automated way. It suggests to use the full text of patents as the
main source of information. It develops a set of three approaches that identifies regular linguistic
constructs and abstract rules for the identification of affordance-related expressions.
The methodologies significantly improves over the existing literature, which is largely based on case
studies and experimental studies, usually involving a small subset of affordances. It is shown that
these words include many false positives and suggests that an appropriate subset of words ending with
ability can be defined by restricting to those including functional verbs. It is also shown that limiting
the search to words ending with the ability suffix generates false negatives, or affordance-related
expressions that are formed by several words simply because the English language pronunciation does
not permit to collapse the meaning into one word.
On the basis of this methodology, an extensive search for affordance-related expressions is carried out
in the full text of patents.
2494
ICED19
It has also been shown that the number of patents including explicitly the word affordance and
user are correlated, but for new and emerging technologies the frequency of user-related words
largely outnumbers the affordance-related frequency. This is a hint to the dynamic process of
affordance creation, which requires extensive user experience before becoming an automatic cognitive
mechanism.
Finally, the conditions for creating practical tools to support the designer activity are identified.
Searching for statistically validated correspondences between features of objects and users immediate
experiences will deliver a large collection of suggestions for practical use by designers.
REFERENCES
Bonaccorsi, A. and Fantoni, G. (2007), Expanding the functional ontology in conceptual design”, In:
International Conference on Engineering Design. Citeseer.
Bonino, D. Ciaramella, A. and Corno, F. (2010), Review of the state-of-the-art in patent information and
forthcoming evolutions in intelligent patent informatics”, World Patent Information, Vol. 32 No. 1 3038.
Boyack, K.W., Small, H. and Klavans, R. (2013), Improving the accuracy of co-citation clustering using full
text”, Journal of the American Society for Information Science and Technology, Vol. 64 No. 9,
pp. 17591767.
Brown, D.C. and Blessing, L. (2005), The relationship between function and affordance”, In: ASME 2005
International Design Engineering Technical Conferences and Computers and Information in Engineering
Conference, American Society of Mechanical Engineers, pp. 155160.
Cascini, G., Del Frate, L., Fantoni, G. and Montagna, F. (2011), Beyond the design perspective of Gero’s FBS
framework”, In: Design computing and cognition, Springer, Vol. 10, pp. 7796.
Chemero. A. (2003), An outline of a theory of affordances”, Ecological psychology, Vol. 15 No. 2,
pp. 181195.
De Benetti, N., Fantoni, G., Chiarello, F., Bonaccorsi, A., Fadel, G. and Mata, I. (2017), On the relationship
between affordance and expected performance”, In: DS 87-4 Proceedings of the 21st International
Conference on Engineering Design (ICED 17) Vol 4: Design Methods and Tools, Vancouver, Canada, 21-
25.08. 2017.
Dong, H. and Vanns, N. (2009), Designing an innovative pill dispenser: An undergraduate level case study of
inclusive design”, The Design Journal, Vol. 12 No. 1, pp. 95115.
Ernst, H. (2003), Patent information for strategic technology management”, World patent information, Vol. 25
No. 3, pp. 233242.
Gaver, W.W. (1991), Technology affordances”, In: Proceedings of the SIGCHI conference on Human factors in
computing systems, ACM, pp. 7984.
Gero J.S. and Kannengiesser, U. (2004), The situated functionbehaviourstructure framework”, Design
studies, Vol. 25 No. 4, pp. 373391.
Gibson, J.J. (1996), The senses considered as perceptual systems”.
Gibson, J.J. (2014), The ecological approach to visual perception: classic edition”, Psychology Press.
Gibson, K.R., Gibson K.R. and Ingold, T. (1994), Tools, language and cognition in human evolution”,
Cambridge University Press.
Goodman-Deane, J., Waller, S., Bradley, M., Yoxall, A., Wiggins, D. and Clarkson, P. J. (2016), Designing
Inclusive Packaging”, In: Integrating the Packaging and Product Experience in Food and Beverages,
Woodhead Publishing, pp. 3757.
Jamone, L. Ugur, E., Cangelosi, A., Fadiga, L., Bernardino, A., Piater, J. and Santos-Victor, J. (2018),
Affordances in psychology, neuroscience, and robotics: A survey”, IEEE Transactions on Cognitive and
Developmental Systems, Vol. 10, No. 1, pp. 425,.
Kannengiesser, U. and Gero, J.S (2012), A process framework of affordances in design”, Design Issues, Vol. 28
No. 1, pp. 5062.
Langdon, P., Johnson, D., Huppert, F. and Clarkson, P. J. (2015), A framework for collecting inclusive design
data for the UK population”, Applied ergonomics, Vol. 46, pp. 318324.
Maier, J.R.A. and Fadel, G.M. (2003), Affordance-based methods for design”, In: ASME 2003 International
Design Engineering Technical Conferences and Computers and Information in Engineering Conference,
American Society of Mechanical Engineers, pp. 785794.
Masahiro, M. (1970), Bukimi no tani - The uncanny valley”, Energy, (MacDorman, K. F. and Minato, T.,
Trans.), Vol. 7 No. 4, pp. 3335.
Nagel, J.K.S., Stone, R.B., and McAdams, D.A. (2010), An engineering-to-biology thesaurus for engineering
design”, In: ASME 2010 international design engineering technical conferences and computers and
information in engineering conference, American Society of Mechanical Engineers, pp. 117128.
Norman. D. A. (1999), Affordance, conventions, and design”, interactions, Vol. 6 No. 3, pp. 3843.
2495
ICED19
Pahl G. and Beitz, W. (2013), Engineering design: a systematic approach”, Springer Science and Business
Media.
Savransky, S.D. (2000), Engineering of creativity: Introduction to TRIZ methodology of inventive problem
solving”. CRC Press.
Stoffregen, T.A. (2003), Affordances as properties of the animal-environment system”, Ecological psychology,
Vol. 15 No. 2 pp. 115134.
Spreafico, C., Fantoni, G. and Russo, D. (2015), Fbs models: an attempt at reconciliation towards a common
representation”, In: proceedings of the International Conference on Engineering Design, Vol. 2, Design
Society, p. 399408.
Stone, R.B. and Wood, K. L. (2000), Development of a functional basis for design”, Journal of Mechanical
design, Vol. 122 No. 4, pp. 359370.
Turvey, M.T. (1992), Affordances and prospective control: An outline of the ontology”, Ecological psychology,
Vol. 4 No. 3, pp. 173187.
Yuen-Hsien, T., Chi-Jen, L. and Yu-I, L. (2007), Text mining techniques for patent analysis”, Information
Processing & Management, Vol. 43 No. 5, pp. 12161247.
2496
... The use of Text Mining (TM), together with the development of Natural Language Processing (NLP) techniques, shows breakthrough results in their applications for Engineering Design purposes [10,11]. However, there are still challenges and problems to overcome, such as the treatment of difficult concepts such as the one related to both design and cognition [10,12]. ...
... The use of Text Mining (TM), together with the development of Natural Language Processing (NLP) techniques, shows breakthrough results in their applications for Engineering Design purposes [10,11]. However, there are still challenges and problems to overcome, such as the treatment of difficult concepts such as the one related to both design and cognition [10,12]. This is because natural language is quite ambiguous and fuzzy in itself when describing objects of common life. ...
... The first work that shows an application of such techniques in Design Cognition is the one of Chiarello et al. [10] that extracts artifacts that are able to activate spontaneous and immediate users' reactions, such as affordances. They propose an NLP-based approach to extract affordances from patents using the combination of gazeetteers (or lexicon) and lexical and syntactic rules. ...
Conference Paper
Full-text available
The main approaches to study the cognitive aspects of product-use interaction involve many theoretical models that map the match or mismatch among the users’ and designers’ knowledge, beliefs, and expectations into positive interactions (affordances, alternative uses) or negative interactions (misuse and failure). However, these assumptions have only been approached theoretically and hardly find empirical consensus in Engineering Design. For this reason, the aim of this paper is to show how it is possible to apply Text Mining to empirically demonstrate a theoretical model developed to interpret the cognitive aspects of product-use interaction. We approached this study by analyzing the textual content of patents to empirically demonstrate the reasoning of the following cognitive aspects: affordances, bad design, and bias. In particular, we developed a framework called Affordance-Bias-Cognition (ABC) reasoning that aims at demonstrating that when humans (designers or users) approach objects, they follow a well-defined pattern of cognitive activities (or phases): cause, perception, interpretation, manipulation, and check. Furthermore, we demonstrate that affordances, bad design, and bias follow the same cognitive processes, and that differs only because users and designers, acting like humans, have misconceptions that lead to positive and negative interactions.
... However, it is noteworthy that in their paper may not encompass all essential design entities. Some entities, such as "misuse," "affordance," and "wirk elements" are marginally extracted with NLP, despite the existence of preliminary works attempting to recognize these entities in textual data (Chiarello et al., 2019;Melluso et al., 2021). Another difficulty to be considered is related to certain entities can be considered atomic (a single irreducible unit) and others not. ...
Article
Full-text available
Natural Language Processing (NLP) has been extensively applied in design, particularly for analyzing technical documents like patents and scientific papers to identify entities such as functions, technical feature, and problems. However, there has been less focus on understanding semantic relations within literature, and a comprehensive definition of what constitutes a relation is still lacking. In this paper, we define relation in the context of design and the fundamental concepts linked to it. Subsequently, we introduce a framework for employing NLP to extract relations relevant to design.
... The aforementioned studies are mainly aimed at alleviating the problem of this paper and lack in-depth research on the issue. In this study, the new knowledge graph connecting data science and engineering design inspires [15][16][17][18], and we propose a new industrial safety knowledge graph integrating matter of fact, which is based on industrial safety reports and can improve the effective comprehensiveness of safety reports. First, because the knowledge structure of different processes in different process industries is different [19], for example, the "low-low interlock" of the oil and gas inlet process and the "open valve" of the vaporization process are different, we analyze and summarize and creatively develop a general safety knowledge standardization framework for industrial safety report extraction in a top-down manner. ...
Article
Full-text available
There are some representative reports in industrial safety engineering, such as the Hazard and Operability Analysis and Pre-Hazard Analysis; however, a large amount of industrial safety knowledge in the report has not been fully explored. In order to reuse and release the value of industrial safety knowledge, this paper constructs a new industrial safety knowledge extraction framework. The framework combines the asset management shell to summarize the knowledge concept entities of machine description language and model description language. According to the safety report template, the framework also constructs a new industrial safety knowledge-mapping standard structure. Specifically, firstly, considering that the knowledge structure of safety reports is different in different processes of the process industry, this paper innovatively proposes a general industrial safety knowledge-mapping standard structure, which provides a practical solution for the integration of industrial knowledge representation problems in different processes. Secondly, based on the research progress of named entities, this paper presents an industrial named entity extraction method (INERM) for the process industry. This method designs an entity weight model to calculate the entity weight of each sentence, and adds part-of-speech weight to improve the entity extraction algorithm, which alleviates the problem that the existing entity extraction methods cannot reasonably use the semantic information and context of word. Finally, we construct a triple of industrial safety knowledge based on the rules and store it in Neo4j. In this paper, four semantic-type templates and five semantic relation templates are constructed based on the new industrial safety knowledge map standardization construction process of the process industry. The comparative experiments show that the accuracy of the INERM on the test set is improved by 17 percentage points on average compared with other key entity extraction algorithms. A total of 1329 entities are constructed in the directional application example of the fluid transportation process, which provides a large number of references for the safety of the fluid transportation process and is more conducive to improving the safety guarantee of the fluid transport process.
... As pointed out in Section 4, the NER system enables us to identify an average of 0.35 technologies per sentence (approximately 1 technology every 3 sentences) and a median of 10 distinct technologies per patent. Therefore, technologies are not rare words in patents if compared with other recognizable entities, such as users (Chiarello et al., 2018a), advantages/drawbacks (Chiarello et al., 2017), affordances (Chiarello et al., 2019) and biases . ...
Article
Identifying technologies is a key element for mapping a domain and its evolution. It allows managers and decision makers to anticipate trends for an accurate forecast and effective foresight. Researchers and practitioners are taking advantage of the rapid growth of the publicly accessible sources to map technological domains. Among these sources, patents are the widest technical open access database used in the literature and in practice. Nowadays, Natural Language Processing (NLP) techniques enable new methods for the analysis of patent texts. Among these techniques, in this paper we explore the use of Named Entity Recognition (NER) with the purpose to identify the technologies mentioned in patents' text. We compare three different NER methods, gazetteer-based, rule-based and deep learning-based (e.g. BERT), measuring their performances in terms of precision, recall and computational time. We test the approaches on 1600 patents from four assorted IPC classes as case studies. Our NER systems collected over 4500 fine-grained technologies, achieving the best results thanks to the combination of the three methodologies. The proposed method overcomes the literature thanks to the ability to filter generic technological terms. Our study delineates a valid technology identification tool that can be integrated in any text analysis pipeline to support academics and companies in investigating a technological domain.
... The extraction of design relevant information from technical texts is a task that is affecting latest research endeavours in different academic fields, such as Engineering Design and Artificial Intelligence. The work done by the academic community in using text mining for engineering design purposes is currently demonstrating promising results (Chiarello et al. 2019a;Chiarello et al. 2020;Fantoni et al. 2020). For example, NLP-based methodologies are used to detect and extract information about the functions, the physical behaviours and the states of the system directly from the text of a patent in an automatic way . ...
Article
Full-text available
The representation of the product use context is a well established design practice in Engineering Design. Recently, design theory is studying the product interaction involving several cognitive aspects such as the possible conditions in which a wrong interaction occurs. The aim of this paper is to find a quantitative evidence of the causes of these misuses. In particular, this study focuses on the detection of bad design and biases. In this paper, we propose a method that helps to the automatic detection of bad design and biases from patents. The method is based on an approach that defines syntactic rules to detect sentences containing these artifacts. These rules are defined based on an exploratory analysis of the explicit mention of “bad design” and “bias” and then, tested with multiple experiments on a sample of patents. The results give a first quantitative evidence of the presence of bad design and biases in patents and consequently of their importance in the design theory. In particular, it is provided a fine grain analysis of the linguistic structure of sentences containing these artifacts helping designers in detecting automatically them from patents.
... Recent literature has also demonstrated that Natural Language Processing techniques can be used to mine information from IP related documents, especially from patents (Chiarello et al., 2017(Chiarello et al., , 2018aChiarello et al., 2019) and technical specifications . Recent Named Entity Recognition systems have been applied to patent documents in order to extract design relevant information (Lee and Hsiang, 2019;Chen et al., 2020;Kim and Yoon, 2021). ...
Article
Full-text available
Engineering design (ED) is the process of solving technical problems within requirements and constraints to create new artifacts. Data science (DS) is the inter-disciplinary field that uses computational systems to extract knowledge from structured and unstructured data. The synergies between these two fields have a long story and throughout the past decades, ED has increasingly benefited from an integration with DS. We present a literature review at the intersection between ED and DS, identifying the tools, algorithms and data sources that show the most potential in contributing to ED, and identifying a set of challenges that future data scientists and designers should tackle, to maximize the potential of DS in supporting effective and efficient designs. A rigorous scoping review approach has been supported by Natural Language Processing techniques, in order to offer a review of research across two fuzzy-confining disciplines. The paper identifies challenges related to the two fields of research and to their interfaces. The main gaps in the literature revolve around the adaptation of computational techniques to be applied in the peculiar context of design, the identification of data sources to boost design research and a proper featurization of this data. The challenges have been classified considering their impacts on ED phases and applicability of DS methods, giving a map for future research across the fields. The scoping review shows that to fully take advantage of DS tools there must be an increase in the collaboration between design practitioners and researchers in order to open new data driven opportunities.
Article
Full-text available
Patent data have been utilized for engineering design research for long because of its large and expanding size, wide variety, and massive amount of design information contained in patents. Recent advances in artificial intelligence and data science present unprecedented opportunities to develop data-driven design methods and tools and to enable advanced understanding of design science based on the patent database. Herein, we survey the patent-for-design literature categorized by their contributions to design research and practice, including design theories, methods, tools, and strategies, as well as the forms of patent data and the data science methods in respective studies. Based on systematic review and analysis, our review sheds light on promising future research directions for the field.
Article
Hazard and operability analysis (HAZOP) is a remarkable representative in industrial safety engineering. However, a great storehouse of industrial safety knowledge (ISK) in HAZOP reports has not been thoroughly exploited. In order to reuse and unlock the value of ISK and optimize HAZOP, we have developed a novel knowledge graph for industrial safety (ISKG) with HAZOP as the carrier through bridging data science and engineering design. Specifically, firstly, considering that the knowledge contained in HAZOP reports of different processes in industry is not the same, we creatively developed a general ISK standardization framework, it provides a practical scheme for integrating HAZOP reports from various processes and uniformly representing the ISK with diverse expressions. Secondly, we conceive a novel and reliable information extraction model based on deep learning combined with data science, it can effectively mine ISK from HAZOP reports, which alleviates the obstacle of ISK extraction caused by the particularity of HAZOP text. Finally, we build ISK triples and store them in the Neo4j graph database. We take indirect coal liquefaction process as a case study to develop ISKG, and its oriented applications can optimize HAZOP and mine the potential of ISK, which is of great significance to improve the security of the system and enhance prevention awareness for people. ISKG containing the ISK standardization framework and the information extraction model sets an example of the interaction between data science and engineering design, which can enlighten other researchers and extend the perspectives of industrial safety.
Article
The process of extracting relevant technical information from patents or technical literature is as valuable as it is challenging. It deals with highly relevant information extraction from a corpus of documents with particular structure, and a mix of technical and legal jargon. Patents are the wider free source of technical information where homogeneous entities can be found. From a technical perspective the approaches refer to Named Entity Recognition (NER) and make use of Machine Learning techniques for Natural Language Processing (NLP). However, due to the large amount of data, to the complexity of the lexicon, the peculiarity of the structure and the scarcity of the examples to be used to feed the machine learning system, new approaches should be studied. NER methods are increasing their performances in many contexts, but a gap still exists when dealing with technical documentation. The aim of this work is to create an automatic training sets for NER systems by exploiting the nature and structure of patents, an open and massive source of technical documentation. In particular, we focus on collecting the context where users of the invention appear within patents. We then measure to which extent we achieve our goal and discuss how much our method is generalisable to other entities and documents.
Article
Full-text available
The concept of affordances appeared in psychology during the late 60's as an alternative perspective on the visual perception of the environment. It was revolutionary in the intuition that the way living beings perceive the world is deeply influenced by the actions they are able to perform. Then, across the last 40 years, it has influenced many applied fields: e.g. design, human-computer interaction, computer vision, robotics. In this paper we offer a multidisciplinary perspective on the notion of affordances: we first discuss the main definitions and formalizations of the affordance theory, then we report the most significant evidence in psychology and neuroscience that support it, and finally we review the most relevant applications of this concept in robotics. Index Terms—Affordances, ecological perception, cognitive system and development, embodied cognition, robots with development and learning skills.
Chapter
Full-text available
The user experience can be greatly affected by the demands made by packaging on users' capabilities such as vision and dexterity. Packaging with features that are hard to see, manipulate, or understand can result in difficulty, frustration, or even outright exclusion. This particularly affects older people and those with disabilities, but can also cause problems for more mainstream users. Inclusive design presents a way to address these issues. This chapter outlines the key principles of inclusive design and shows how they apply to packaging, presenting a framework for putting inclusive design into practice. Simulators and personas are then described, as examples of tools that are particularly helpful in inclusive design. These tools can help to develop and explore an understanding of user needs and of the effects of capability loss on the use of packaging. Real-world examples are provided to show how these apply to packaging design in practice.
Conference Paper
Full-text available
Engineering design is considered a creative field that involves many activities with the end goal of a new product that fulfills a purpose. Utilization of systematic methods or tools that aid in the design process is recognized as standard practice in industry and academia. The tools are used for a number of design activities (i.e., idea generation, concept generation, inspiration searches, functional modeling) and can span across engineering disciplines, the sciences (i.e., biology, chemistry) or a non-engineering domain (i.e., medicine), with an overall focus of encouraging creative engineering designs. Engineers, however, have struggled with utilizing the vast amount of biological information available from the natural world around them. Often it is because there is a knowledge gap or terminology is difficult, and the time needed to learn and understand the biology is not feasible. This paper presents an engineering-to-biology thesaurus, which we propose affords engineers, with limited biological background, a tool for leveraging nature’s ingenuity during many steps of the design process. Additionally, the tool could also increase the probability of designing biologically-inspired engineering solutions. Biological terms in the thesaurus are correlated to the engineering domain through pairing with a synonymous function or flow term of the Functional Basis lexicon, which supports functional modeling and abstract representation of any functioning system. The second version of the thesaurus presented in this paper represents an integration of three independent research efforts, which include research from Oregon State University, the University of Toronto, and the Indian Institute of Science, and their industrial partners. The overall approach for term integration and the final results are presented. Applications to the areas of design inspiration, comprehension of biological information, functional modeling, creative design and concept generation are discussed. An example of comprehension and functional modeling are presented.
Article
Full-text available
The purpose of this paper is to attempt to clarify the concept of affordances, as introduced by Maier and Fadel, to relate affordances to function, to try to reduce confusion about both of these terms by providing a detailed model, and to expose some of the existing research on function to a wider audience. The paper starts by constructing a model of function that relates devices to an environment. We then extend the model to include goals. Next we express the concept of affordances in terms of the model already constructed. The paper concludes by discussing the impact that use of affordances might have on the designer's pattern of reasoning.
Conference Paper
In previous work, the authors have suggested that the concept of affordance, a term borrowed from the field of perceptual psychology, should be considered as more fundamental to design than other concepts such as function and behavior. This paper continues this avenue of research by presenting a generalized theory of affordances applicable to design. Then several affordance-based methods for design are presented with brief examples. Methods are introduced for designing Artifact-User Affordances, Artifact-Artifact Affordances, various kinds of graphical affordance structures, embodiment design, and reverse engineering. The affordance-based methods presented offer a very different way of thinking from what would be used in a purely functional approach. In particular, the affordance-based methods emphasize satisfaction of user demands and wishes (what the artifact should afford) while safeguarding at each step against introducing unwanted or dangerous features (what the artifact should not afford). The affordance-based methods also lend themselves to taking advantage of the multiple afffordances of various objects, to achieve naturally what is sometimes termed “functional integration”.
Book
Invention and innovation lie at the heart of problem solving in virtually every discipline, but they are not easy to come by. Divine inspiration aside, historically we have depended primarily on observation, brainstorming, and trial-and-error methods to develop the innovations that provide solutions. But these methods are neither efficient nor dependable enough for the high-quality, high-tech engineering solutions we need today. TRIZ is a unique and powerful, algorithmic approach to problem solving that demonstrated remarkable effectiveness in its native Russia, and whose popularity has now spread to organizations such as Ford, NASA, Motorola, Unisys, and Rockwell International. Until now, however, no comprehensive, comprehensible treatment, suitable for self-study or as a textbook, has been available in English. Engineering of Creativity provides a valuable opportunity to learn and apply the concepts and techniques of TRIZ to complex engineering problems. The author-a world-renowned TRIZ expert-covers every aspect of TRIZ, from the basic concepts to the latest research and developments. He provides step-by-step guidelines, case studies from a variety of engineering disciplines, and first-hand experience in using the methodology. Application of TRIZ can bring high-quality-even breakthrough-conceptual solutions and help remove technical obstacles. Mastering the contents of Engineering of Creativity will bring your career and your company a remarkable advantage: the ability to formulate the best possible solutions for technical systems problems and predict future developments.
Article
Functional analysis represents one of the key tools for designers at a conceptual design stage. It describes a product or a problem at an abstract level allowing a clear and standard representation aimed to an effective exploration of different design alternatives (functional variants). In engineering design, the existence of a product is subjected to its function. Functional modelling helps the designer to provide an abstract, yet direct, method for understanding and representing the functions of a product or artefact. Functional analysis however, traditionally found a lot of difficulties in practical industrial application. One reason is that it forces designers to think in highly abstract terms, contrary to their natural attitude and cognitive style. Furthermore, a long preparation is needed in order to carry out sessions of functional analysis, making the technique hard to be implemented. This situation has spurred efforts for the development of standardized dictionaries, in order to support the reasoning process. A formal representation, in fact, is necessary to support functional modelling. A standardized dictionary of functions leads to repeatable and meaningful results from such representation. A very interesting proposal of functional basis leading to the integration of several independent research efforts into a reconciled structure has been recently published in the literature. Unfortunately, since its aim was to describe every electro-mechanical function with a minimal number of verbs, the reconciled functional basis is pretty poor of entries. This restriction obstacles the automatic extraction of functional verbs, makes the learning period quite long, and makes it difficult to perform efficient search for functional variants. To answer these needs a new dictionary and thesaurus of functional and structural verbs has been studied and developed. A team of mechanical engineers, economists, and experts of text mining and focused search engines collaborated for a long period in order to extract functional verbs from technical texts. We have developed a large dictionary, alongside a novel hierarchical classification, including detailed treatment of synonyms and antonyms. On the basis of this new representation, implemented in a software application tool, it is possible to rapidly map the functional tree associated to any function. In addition to the theoretical value of this development, practical implementations are in progress. Preliminary tests have been performed in the context of patent analysis. Critical applications concern early product development in the automotive industry, supporting product development sessions.