Wrox Programmer Forums

Need to download code?

View our list of code downloads.

Go Back   Wrox Programmer Forums > XML > XSLT
Password Reminder
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read
XSLT General questions and answers about XSLT. For issues strictly specific to the book XSLT 1.1 Programmers Reference, please post to that forum instead.
Welcome to the p2p.wrox.com Forums.

You are currently viewing the XSLT section of the Wrox Programmer to Programmer discussions. This is a community of tens of thousands of software programmers and website developers including Wrox book authors and readers. As a guest, you can read any forum posting. By joining today you can post your own programming questions, respond to other developers’ questions, and eliminate the ads that are displayed to guests. Registration is fast, simple and absolutely free .
DRM-free e-books 300x50
Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old May 17th, 2006, 06:39 AM
Registered User
Join Date: May 2006
Location: bangalore, Karnataka, India.
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
Send a message via AIM to balasundarrao Send a message via Yahoo to balasundarrao
Default how to avoid duplicate values from the xml file us


case 1 :
using xslt i want to display only (i dont want to display the repeating values.)

case 2 : to find out the count of repeating values
please help me. how to do it.


Reply With Quote
  #2 (permalink)  
Old May 17th, 2006, 07:02 AM
mhkay's Avatar
Wrox Author
Points: 18,487, Level: 59
Points: 18,487, Level: 59 Points: 18,487, Level: 59 Points: 18,487, Level: 59
Activity: 100%
Activity: 100% Activity: 100% Activity: 100%
Join Date: Apr 2004
Location: Reading, Berks, United Kingdom.
Posts: 4,962
Thanks: 0
Thanked 292 Times in 287 Posts

In XSLT 2.0, use <xsl:for-each-group>

In 1.0, please see http://www.jenitennison.com/xslt/grouping

Michael Kay
Author, XSLT Programmer's Reference and XPath 2.0 Programmer's Reference
Reply With Quote
  #3 (permalink)  
Old June 4th, 2014, 11:56 PM
Registered User
Points: 6, Level: 1
Points: 6, Level: 1 Points: 6, Level: 1 Points: 6, Level: 1
Activity: 0%
Activity: 0% Activity: 0% Activity: 0%
Join Date: Jun 2014
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts

If you can ensure the duplicate nodes are always consecutive, then the simplest way to do this is build upon the XSTL Identity Transform an just have an extra template to strip out the templates like so

[name() = preceding-sibling::*[1]/name()]
[@value = preceding-sibling::*[1]/@value]" />

This matches any child element, and ignores it if it has the same name and value as the previous element. There is no need to hard-code an element name anywhere in this case.

Here is the full XSLT in this case

<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output method="xml" indent="yes" />

<xsl:template match="@*|node()">
<xsl:apply-templates select="@*|node()"/>

<xsl:template match="*[not(*)][name() = preceding-sibling::*[1]/name()][@value = preceding-sibling::*[1]/@value]" />

However this would fail if your XML looked like this, and your duplicate nodes were consecutive

<name value="galaxy"/>
<name value="galaxys"/>
<id value="123"/>
<name value="galaxy"/>
<id value="123"/>
<name2 value="galaxy"/>

You could fix this by changing the template to check back all previous nodes

<xsl:template match="*[not(*)]
[name() = preceding-sibling::*/name()]
[@value = preceding-sibling::*/@value]" />

However, this starts to become inefficient with large numbers of elements. If you have hundred of elements, then each precedinig-sibling check will repeatedly involve checking hundred of elements (i.e the 100th element has to check 99 preceding ones, the 101th element checks 100 ones, etc).

A more efficient method (in XSLT1.0) is to use a technique called Muenchian Grouping. It is certainly something worth learning about if you use XSLT a lot.

First you define a key to 'group' your elements. In this case, your are looking for distinct elements defined by their parent, element name, and value

<xsl:key name="duplicate" match="*[not(*)]" use="concat(generate-id(..), '|', name(), '|', @value)" />

Then to ignore the duplicates, you match any element that doesn't occur in the first position in the key for the given 'lookup' value

<xsl:template match="*[not(*)]
[generate-id() !=
generate-id(key('duplicate', concat(generate-id(..), '|', name(), '|', @value))[1])]" />

Here is the full XSLT in this case

<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output method="xml" indent="yes" />
<xsl:key name="duplicate" match="*[not(*)]" use="concat(generate-id(..), '|', name(), '|', @value)" />

<xsl:template match="@*|node()">
<xsl:apply-templates select="@*|node()"/>

<xsl:template match="*[not(*)][generate-id() != generate-id(key('duplicate', concat(generate-id(..), '|', name(), '|', @value))[1])]" />


share|improve this answer

edited Apr 23 '13 at 7:24

answered Apr 19 '13 at 13:04
Tim C

Very god answer. I thought about something like this, but was to lazy. But wouldn't it be even better to use generate-id(..) instead of name(..) as key? Then in would also work with more same named parent nodes. – hr_117 Apr 19 '13 at 15:40

That is a good point. I've amended my answer to do just that. Thanks! – Tim C Apr 19 '13 at 16:10

I tried the code, but it's deleting every element not just duplicates. Am I doing anything wrong? – knix2 Apr 22 '13 at 7:20

The original XML in your question is not actually well-formed, which suggests you are using different XML to what you have shown us. If you could show us a more accurate sample, one that is not getting the results you want, that may help. Thanks! – Tim C Apr 22 '13 at 7:42

@ Tim C **This is sample xml on which I tried your code**<?xml version="1.0" encoding="UTF-8"?> <check> <val> <Samsung> <name value="galaxy" /> <name value="galaxy" /> <name value="galaxys" /> <id value="123" /> <id value="123" /> <name2 value="galaxy" /> </Samsung> <htc> <name value="galaxy" /> <name value="galaxy" /> <name value="galaxys" /> <id value="123" /> <id value="123" /> <name2 value="galaxy" /> </htc> </val> </check> – knix2 Apr 22 '13 at 9:25
Reply With Quote

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
How Do I avoid duplicate values xsltier XSLT 3 June 4th, 2008 01:36 PM
how to avoid duplicate contacts? combo box? dstein4d Access VBA 5 February 26th, 2008 05:55 PM
avoid duplicate entry of records mikersantiago Classic ASP Basics 4 February 10th, 2005 09:14 PM
avoid adding duplicate records in access/asp mikersantiago Classic ASP Basics 1 September 21st, 2004 03:24 AM
Avoid duplicate node values nambati XSLT 1 September 8th, 2004 02:41 PM

All times are GMT -4. The time now is 03:48 PM.

Powered by vBulletin®
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
© 2013 John Wiley & Sons, Inc.