<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Common Event Exchange Formats &#8211; XDAS</title>
	<atom:link href="http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/feed/" rel="self" type="application/rss+xml" />
	<link>http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/</link>
	<description>Log visualization and log management as seen by Raffael Marty</description>
	<lastBuildDate>Thu, 26 Jan 2012 07:17:42 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
	<item>
		<title>By: Anton Chuvakin</title>
		<link>http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/comment-page-1/#comment-6342</link>
		<dc:creator>Anton Chuvakin</dc:creator>
		<pubDate>Mon, 02 Jul 2007 19:49:23 +0000</pubDate>
		<guid isPermaLink="false">http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/#comment-6342</guid>
		<description>Is someone confusing CEF with CEE?</description>
		<content:encoded><![CDATA[<p>Is someone confusing CEF with CEE?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Raffael Marty</title>
		<link>http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/comment-page-1/#comment-6299</link>
		<dc:creator>Raffael Marty</dc:creator>
		<pubDate>Fri, 29 Jun 2007 15:58:40 +0000</pubDate>
		<guid isPermaLink="false">http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/#comment-6299</guid>
		<description>Here ya go... The &lt;a href=&quot;http://raffy.ch/blog/wp-content/uploads/2007/06/CEF.pdf&quot; rel=&quot;nofollow&quot;&gt;CEF&lt;/a&gt; standard.</description>
		<content:encoded><![CDATA[<p>Here ya go&#8230; The <a href="http://raffy.ch/blog/wp-content/uploads/2007/06/CEF.pdf" rel="nofollow">CEF</a> standard.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: DC</title>
		<link>http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/comment-page-1/#comment-6283</link>
		<dc:creator>DC</dc:creator>
		<pubDate>Thu, 28 Jun 2007 20:48:04 +0000</pubDate>
		<guid isPermaLink="false">http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/#comment-6283</guid>
		<description>Can you post the CEF open standard or is it Arcsight proprietary?</description>
		<content:encoded><![CDATA[<p>Can you post the CEF open standard or is it Arcsight proprietary?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: John Calcote</title>
		<link>http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/comment-page-1/#comment-6280</link>
		<dc:creator>John Calcote</dc:creator>
		<pubDate>Thu, 28 Jun 2007 19:56:20 +0000</pubDate>
		<guid isPermaLink="false">http://raffy.ch/blog/2007/06/07/common-event-exchange-formats-xdas/#comment-6280</guid>
		<description>Raffy, To quote Shakespeare, &lt;blockquote&gt;Me thinks thou dost protest too much...&lt;/blockquote&gt;

I&#039;ll just take your comments point by point, if you don&#039;t mind:

1. Novell is using XDAS. What makes ArcSight&#039;s use of CEF more significant?

2. You&#039;ve clearly not read many standards - have you seen the IETF RFC for the HTTP protocol? - It&#039;s a fairly simple protocol, but it&#039;s well over 100 pages. Pick any other standards (SMNP, SMTP, FTP, SSH, etc) and check how many pages they have. Don&#039;t limit the number of pages to the material you can read before you fall asleep. Standards are like legal documents to technicians - they should communicate intent clearly, and that takes words in a row.

3. By &lt;em&gt;implement&lt;/em&gt;, do you mean the audit system itself, or application instrumentation? You don&#039;t implement any system worth having without some effort. A couple of weeks? More like a couple of months before the first release - as it should be. We&#039;re not writing in PHP or Javascript here. This is security code, and it has to be secure, which requires careful thought and significant effort.

4. The XDAS standard defines three very critical aspects of auditing: API, Record Format, and Taxonomy. API is defined because too many people have reinstrumented for different audit systems too many times. Most of them can relate to this design choice. Record format allows everyone to work together on analysis systems. Taxonomy exists to allow everyone to work in the same context. Transport is specifically NOT defined. It&#039;s indicated on the block diagram as necessary, but purposely specified as implementation defined.

5. The XDAS service exists to coordinate logging from multiple processes into a single sink. This shouldn&#039;t be that hard to understand. A single process should always (for security and architectural reasons) coordinate the funnelling of data from multiple sources into a single sink.

6. XDAS is not an event interchange standard - it&#039;s a distributed security event management standard. It&#039;s designed to ensure that the proper data gets from multiple sources to the proper place without tampering. This requires some degree of access control. Filtering is discussed simply for the sake of performance, and I don&#039;t see anything about RBAC in the spec.

7. Yes, audit is all about security events, and it should be strictly limited to security events. XDAS very purposely does NOT define a generic event bus. We have WAY too many of those today, and none of them do what they need for proper auditing. The last thing we want is for people to dump their debug events into the audit log. Most audit logs today contain 99 percent useless garbage (from an auditing perspective), which means that analysis tools spend most of their processing time just filtering and correlating. The point is that engineers should think of auditing as a separate and distinct process from logging.

8, 9, 10, 14. On these points, I agree - the record format could use some updating. The XDAS preliminary specification was written in 1998, before the days of XML and before name/value pairs were as popular as they are today. Even so, some of the fields reflect the growing desire to move in this direction. The Open Group has recently re-established the XDAS working group to update this specification to meet today&#039;s needs. The &lt;a href=&quot;http://openxdas.sourceforge.net&quot; title=&quot;OpenXDAS Web Site&quot; rel=&quot;nofollow&quot;&gt;OpenXDAS&lt;/a&gt; project on &lt;a href=&quot;http://www.sourceforge.net/projects/openxdas&quot; title=&quot;OpenXDAS Project Site&quot; rel=&quot;nofollow&quot;&gt;sourceforge.net&lt;/a&gt; is a work in progress. There is one person working full-time on this project, and I can only do so much in a day. But I and those who help me occasionally are working to make things better with each release. Note that the current release is 0.5 - that&#039;s pre-1.0, meaning it&#039;s not what we would consider &lt;em&gt;complete&lt;/em&gt; yet. And finally, some of the fields are being reconsidered. After all, we&#039;re starting with a &lt;em&gt;preliminary specification&lt;/em&gt;, not an existing standard.

11. I&#039;ve no idea what the original author intended by these concepts (access and principal id&#039;s). Does it matter? We&#039;ll probably remove this prose from the spec, if someone in the working group can&#039;t provide a good explanation for them.

12. Why mention actions and alarms? Actions and alarms have nothing to do with log management - they relate to event channel contents. One of the key benefits of a true audit system is the ability to take immediate action based on various types of events being published. A common action is to simply notify a system administrator of possible attack or system failure. While it&#039;s true that most analysis is done on logs, there is a very important place in auditing for real-time alarms and actions built into the event channel itself. XDAS specifies their optional existence, and indicates that the actual nature of these auxilliary services are implementation defined. 

13. Log entry pointers are more for archival interest than for actual analysis. We don&#039;t expect analysis tools to go trapsing back to the original source for details on an XDAS record, although nothing in the specification precludes an implementation from doing so.

14. Again, I agree with you, the record format is not perfect. But it&#039;s not bad either. We&#039;re working on updating it.

15. While the world of today may revolve around syslog, we&#039;re hoping that syslog is not considered the ultimate auditing solution for everyone. We&#039;re actually hoping to improve on today&#039;s tools - if we didn&#039;t think there was room for improvement, then we&#039;d be writing to syslog ourselves. We&#039;re not the only people that feel this way - Red Hat is working on an entire auditing infrastructure for RH Linux that has nothing to do with syslog, unfortinately, it&#039;s very specific to Linux. We will integrate OpenXDAS with this Linux-only system (LAF - linux audit framework) on Linux platforms.

16. The concepts of Originator, Target and Initiator are all well-defined in the spec. Originator is the identity of the service or host that is logging the event. (If you&#039;d read past the first 10 pages, you&#039;d have known that. :)

17. The Taxonomy is being improved by the Open Group working group as I write this. We&#039;re adding events for work flow, among others of security relevance.

18. Outcome encoding, as well as event encoding is being looked as for update by the working group.

The fact is, Novell didn&#039;t want to invent something new (again). We wanted to use an existing standard. When we went looking for such a standard over a year ago, we found XDAS - and that&#039;s about all. Had we known about CEF, we might have gone in that direction, but CEF wasn&#039;t being advertised actively on the Internet back then. We did find a few other efforts such as CMU&#039;s auditing system (&lt;a href=&quot;http://www.cmu.edu/computing/eddy&quot; title=&quot;CMU Eddy Project&quot; rel=&quot;nofollow&quot;&gt;eddy - end-to-end diagnostics discovery&lt;/a&gt;), but nothing was really as close to implmenetation read as XDAS was.

Our first version of OpenXDAS was to provide a pure reference implementation of the standard - implementing the existing specification as closely as possible. The second version (2.x?) will follow the working group updates. This takes time of course, and we wanted something our customers and internal development groups can use today.

John Calcote
System Architect
Novell, Inc.</description>
		<content:encoded><![CDATA[<p>Raffy, To quote Shakespeare,<br />
<blockquote>Me thinks thou dost protest too much&#8230;</p></blockquote>
<p>I&#8217;ll just take your comments point by point, if you don&#8217;t mind:</p>
<p>1. Novell is using XDAS. What makes ArcSight&#8217;s use of CEF more significant?</p>
<p>2. You&#8217;ve clearly not read many standards &#8211; have you seen the IETF RFC for the HTTP protocol? &#8211; It&#8217;s a fairly simple protocol, but it&#8217;s well over 100 pages. Pick any other standards (SMNP, SMTP, FTP, SSH, etc) and check how many pages they have. Don&#8217;t limit the number of pages to the material you can read before you fall asleep. Standards are like legal documents to technicians &#8211; they should communicate intent clearly, and that takes words in a row.</p>
<p>3. By <em>implement</em>, do you mean the audit system itself, or application instrumentation? You don&#8217;t implement any system worth having without some effort. A couple of weeks? More like a couple of months before the first release &#8211; as it should be. We&#8217;re not writing in PHP or Javascript here. This is security code, and it has to be secure, which requires careful thought and significant effort.</p>
<p>4. The XDAS standard defines three very critical aspects of auditing: API, Record Format, and Taxonomy. API is defined because too many people have reinstrumented for different audit systems too many times. Most of them can relate to this design choice. Record format allows everyone to work together on analysis systems. Taxonomy exists to allow everyone to work in the same context. Transport is specifically NOT defined. It&#8217;s indicated on the block diagram as necessary, but purposely specified as implementation defined.</p>
<p>5. The XDAS service exists to coordinate logging from multiple processes into a single sink. This shouldn&#8217;t be that hard to understand. A single process should always (for security and architectural reasons) coordinate the funnelling of data from multiple sources into a single sink.</p>
<p>6. XDAS is not an event interchange standard &#8211; it&#8217;s a distributed security event management standard. It&#8217;s designed to ensure that the proper data gets from multiple sources to the proper place without tampering. This requires some degree of access control. Filtering is discussed simply for the sake of performance, and I don&#8217;t see anything about RBAC in the spec.</p>
<p>7. Yes, audit is all about security events, and it should be strictly limited to security events. XDAS very purposely does NOT define a generic event bus. We have WAY too many of those today, and none of them do what they need for proper auditing. The last thing we want is for people to dump their debug events into the audit log. Most audit logs today contain 99 percent useless garbage (from an auditing perspective), which means that analysis tools spend most of their processing time just filtering and correlating. The point is that engineers should think of auditing as a separate and distinct process from logging.</p>
<p>8, 9, 10, 14. On these points, I agree &#8211; the record format could use some updating. The XDAS preliminary specification was written in 1998, before the days of XML and before name/value pairs were as popular as they are today. Even so, some of the fields reflect the growing desire to move in this direction. The Open Group has recently re-established the XDAS working group to update this specification to meet today&#8217;s needs. The <a href="http://openxdas.sourceforge.net" title="OpenXDAS Web Site" rel="nofollow">OpenXDAS</a> project on <a href="http://www.sourceforge.net/projects/openxdas" title="OpenXDAS Project Site" rel="nofollow">sourceforge.net</a> is a work in progress. There is one person working full-time on this project, and I can only do so much in a day. But I and those who help me occasionally are working to make things better with each release. Note that the current release is 0.5 &#8211; that&#8217;s pre-1.0, meaning it&#8217;s not what we would consider <em>complete</em> yet. And finally, some of the fields are being reconsidered. After all, we&#8217;re starting with a <em>preliminary specification</em>, not an existing standard.</p>
<p>11. I&#8217;ve no idea what the original author intended by these concepts (access and principal id&#8217;s). Does it matter? We&#8217;ll probably remove this prose from the spec, if someone in the working group can&#8217;t provide a good explanation for them.</p>
<p>12. Why mention actions and alarms? Actions and alarms have nothing to do with log management &#8211; they relate to event channel contents. One of the key benefits of a true audit system is the ability to take immediate action based on various types of events being published. A common action is to simply notify a system administrator of possible attack or system failure. While it&#8217;s true that most analysis is done on logs, there is a very important place in auditing for real-time alarms and actions built into the event channel itself. XDAS specifies their optional existence, and indicates that the actual nature of these auxilliary services are implementation defined. </p>
<p>13. Log entry pointers are more for archival interest than for actual analysis. We don&#8217;t expect analysis tools to go trapsing back to the original source for details on an XDAS record, although nothing in the specification precludes an implementation from doing so.</p>
<p>14. Again, I agree with you, the record format is not perfect. But it&#8217;s not bad either. We&#8217;re working on updating it.</p>
<p>15. While the world of today may revolve around syslog, we&#8217;re hoping that syslog is not considered the ultimate auditing solution for everyone. We&#8217;re actually hoping to improve on today&#8217;s tools &#8211; if we didn&#8217;t think there was room for improvement, then we&#8217;d be writing to syslog ourselves. We&#8217;re not the only people that feel this way &#8211; Red Hat is working on an entire auditing infrastructure for RH Linux that has nothing to do with syslog, unfortinately, it&#8217;s very specific to Linux. We will integrate OpenXDAS with this Linux-only system (LAF &#8211; linux audit framework) on Linux platforms.</p>
<p>16. The concepts of Originator, Target and Initiator are all well-defined in the spec. Originator is the identity of the service or host that is logging the event. (If you&#8217;d read past the first 10 pages, you&#8217;d have known that. <img src='http://raffy.ch/blog/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<p>17. The Taxonomy is being improved by the Open Group working group as I write this. We&#8217;re adding events for work flow, among others of security relevance.</p>
<p>18. Outcome encoding, as well as event encoding is being looked as for update by the working group.</p>
<p>The fact is, Novell didn&#8217;t want to invent something new (again). We wanted to use an existing standard. When we went looking for such a standard over a year ago, we found XDAS &#8211; and that&#8217;s about all. Had we known about CEF, we might have gone in that direction, but CEF wasn&#8217;t being advertised actively on the Internet back then. We did find a few other efforts such as CMU&#8217;s auditing system (<a href="http://www.cmu.edu/computing/eddy" title="CMU Eddy Project" rel="nofollow">eddy &#8211; end-to-end diagnostics discovery</a>), but nothing was really as close to implmenetation read as XDAS was.</p>
<p>Our first version of OpenXDAS was to provide a pure reference implementation of the standard &#8211; implementing the existing specification as closely as possible. The second version (2.x?) will follow the working group updates. This takes time of course, and we wanted something our customers and internal development groups can use today.</p>
<p>John Calcote<br />
System Architect<br />
Novell, Inc.</p>
]]></content:encoded>
	</item>
</channel>
</rss>

